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Preface 


This is a text for a two-term course in introductory real analysis for junior or senior math- 
ematics majors and science students with a serious interest in mathematics. Prospective 
educators or mathematically gifted high school students can also benefit from the mathe- 
matical maturity that can be gained from an introductory real analysis course. 


The book is designed to fill the gaps left in the development of calculus as it is usually 
presented in an elementary course, and to provide the background required for insight into 
more advanced courses in pure and applied mathematics. The standard elementary calcu- 
lus sequence is the only specific prerequisite for Chapters 1-5, which deal with real-valued 
functions. (However, other analysis oriented courses, such as elementary differential equa- 
tion, also provide useful preparatory experience.) Chapters 6 and 7 require a working 
knowledge of determinants, matrices and linear transformations, typically available from a 
first course in linear algebra. Chapter 8 is accessible after completion of Chapters 1-5. 


Without taking a position for or against the current reforms in mathematics teaching, I 
think it is fair to say that the transition from elementary courses such as calculus, linear 
algebra, and differential equations to a rigorous real analysis course is a bigger step to- 
day than it was just a few years ago. To make this step today’s students need more help 
than their predecessors did, and must be coached and encouraged more. Therefore, while 
striving throughout to maintain a high level of rigor, I have tried to write as clearly and in- 
formally as possible. In this connection I find it useful to address the student in the second 
person. I have included 295 completely worked out examples to illustrate and clarify all 
major theorems and definitions. 


I have emphasized careful statements of definitions and theorems and have tried to be 
complete and detailed in proofs, except for omissions left to exercises. I give a thorough 
treatment of real-valued functions before considering vector-valued functions. In making 
the transition from one to several variables and from real-valued to vector-valued functions, 
I have left to the student some proofs that are essentially repetitions of earlier theorems. I 
believe that working through the details of straightforward generalizations of more elemen- 
tary results is good practice for the student. 


Great care has gone into the preparation of the 760 numbered exercises, many with 
multiple parts. They range from routine to very difficult. Hints are provided for the more 
difficult parts of the exercises. 


vi 


Preface vii 
Organization 


Chapter | is concerned with the real number system. Section 1.1 begins with a brief dis- 
cussion of the axioms for a complete ordered field, but no attempt is made to develop the 
reals from them; rather, it is assumed that the student is familiar with the consequences of 
these axioms, except for one: completeness. Since the difference between a rigorous and 
nonrigorous treatment of calculus can be described largely in terms of the attitude taken 
toward completeness, I have devoted considerable effort to developing its consequences. 
Section 1.2 is about induction. Although this may seem out of place in a real analysis 
course, I have found that the typical beginning real analysis student simply cannot do an 
induction proof without reviewing the method. Section 1.3 is devoted to elementary set the- 
ory and the topology of the real line, ending with the Heine-Borel and Bolzano- Weierstrass 
theorems. 


Chapter 2 covers the differential calculus of functions of one variable: limits, continu- 
ity, differentiablility, L Hospital’s rule, and Taylor’s theorem. The emphasis is on rigorous 
presentation of principles; no attempt is made to develop the properties of specific ele- 
mentary functions. Even though this may not be done rigorously in most contemporary 
calculus courses, I believe that the student’s time is better spent on principles rather than 
on reestablishing familiar formulas and relationships. 


Chapter 3 is to devoted to the Riemann integral of functions of one variable. In Sec- 
tion 3.1 the integral is defined in the standard way in terms of Riemann sums. Upper and 
lower integrals are also defined there and used in Section 3.2 to study the existence of the 
integral. Section 3.3 is devoted to properties of the integral. Improper integrals are studied 
in Section 3.4. I believe that my treatment of improper integrals is more detailed than in 
most comparable textbooks. A more advanced look at the existence of the proper Riemann 
integral is given in Section 3.5, which concludes with Lebesgue’s existence criterion. This 
section can be omitted without compromising the student’s preparedness for subsequent 
sections. 


Chapter 4 treats sequences and series. Sequences of constant are discussed in Sec- 
tion 4.1. I have chosen to make the concepts of limit inferior and limit superior parts 
of this development, mainly because this permits greater flexibility and generality, with 
little extra effort, in the study of infinite series. Section 4.2 provides a brief introduction 
to the way in which continuity and differentiability can be studied by means of sequences. 
Sections 4.34.5 treat infinite series of constant, sequences and infinite series of functions, 
and power series, again in greater detail than in most comparable textbooks. The instruc- 
tor who chooses not to cover these sections completely can omit the less standard topics 
without loss in subsequent sections. 


Chapter 5 is devoted to real-valued functions of several variables. It begins with a dis- 
cussion of the toplogy of R” in Section 5.1. Continuity and differentiability are discussed 
in Sections 5.2 and 5.3. The chain rule and Taylor’s theorem are discussed in Section 5.4. 
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Chapter 6 covers the differential calculus of vector-valued functions of several variables. 
Section 6.1 reviews matrices, determinants, and linear transformations, which are integral 
parts of the differential calculus as presented here. In Section 6.2 the differential of a 
vector-valued function is defined as a linear transformation, and the chain rule is discussed 
in terms of composition of such functions. The inverse function theorem is the subject of 
Section 6.3, where the notion of branches of an inverse is introduced. In Section 6.4. the 
implicit function theorem is motivated by first considering linear transformations and then 
stated and proved in general. 


Chapter 7 covers the integral calculus of real-valued functions of several variables. Mul- 
tiple integrals are defined in Section 7.1, first over rectangular parallelepipeds and then 
over more general sets. The discussion deals with the multiple integral of a function whose 
discontinuities form a set of Jordan content zero. Section 7.2 deals with the evaluation by 
iterated integrals. Section 7.3 begins with the definition of Jordan measurability, followed 
by a derivation of the rule for change of content under a linear transformation, an intuitive 
formulation of the rule for change of variables in multiple integrals, and finally a careful 
statement and proof of the rule. The proof is complicated, but this is unavoidable. 


Chapter 8 deals with metric spaces. The concept and properties of a metric space are 
introduced in Section 8.1. Section 8.2 discusses compactness in a metric space, and Sec- 
tion 8.3 discusses continuous functions on metric spaces. 


Corrections—mathematical and typographical—are welcome and will be incorporated when 
received. 


William F. Trench 

wtrench @trinity.edu 

Home: 659 Hopkinton Road 
Hopkinton, NH 03229 


CHAPTER 1 


The Real Numbers 


IN THIS CHAPTER we begin the study of the real number system. The concepts discussed 
here will be used throughout the book. 


SECTION 1.1 deals with the axioms that define the real numbers, definitions based on 
them, and some basic properties that follow from them. 


SECTION 1.2 emphasizes the principle of mathematical induction. 


SECTION 1.3 introduces basic ideas of set theory in the context of sets of real num- 
bers. In this section we prove two fundamental theorems: the Heine—Borel and Bolzano— 
Weierstrass theorems. 


1.1 THE REAL NUMBER SYSTEM 


Having taken calculus, you know a lot about the real number system; however, you prob- 
ably do not know that all its properties follow from a few basic ones. Although we will 
not carry out the development of the real number system from these basic properties, it is 
useful to state them as a starting point for the study of real analysis and also to focus on 
one property, completeness, that is probably new to you. 


Field Properties 


The real number system (which we will often call simply the reals) is first of all a set 
{a, b,c,...} on which the operations of addition and multiplication are defined so that 
every pair of real numbers has a unique sum and product, both real numbers, with the 
following properties. 


(A) a+b=b-+aandab = ba (commutative laws). 

(B) @4+b)+c=a+(b +c) and (ab)c = a(bc) (associative laws). 

(C) a(b +c) = ab +c (distributive law). 

(D) There are distinct real numbers 0 and 1 such that a + 0 = a andal =a for alla. 


(E) For each a there is a real number —a such that a + (—a) = 0, and if a # 0, there is 
areal number 1/a such that a(1/a) = 1. 
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The manipulative properties of the real numbers, such as the relations 


(a +b)? =a? + 2ab + b?, 
(3a + 2b)(4c + 2d) = 12ac + 6ad + 8bc + 4bd, 
(—a) = (-l)a, a(—b) = (—a)b = —ab, 


and 


ac ad+be 
a ar ee 


all follow from (A.)—(E). We assume that you are familiar with these properties. 


A set on which two operations are defined so as to have properties (A.)—(E) is called a 
field. The real number system is by no means the only field. The rational numbers (which 
are the real numbers that can be written as r = p/q, where p and q are integers and q 4 0) 
also form a field under addition and multiplication. The simplest possible field consists of 
two elements, which we denote by 0 and 1, with addition defined by 


0+0=14+1=0, 14+0=0+1=1, (1.1.1) 
and multiplication defined by 
0-0=0-1=1-0=0, 1-l=1 (1.1.2) 


(Exercise 1.1.2). 


The Order Relation 


The real number system is ordered by the relation <, which has the following properties. 


(F) For each pair of real numbers a and b, exactly one of the following is true: 


a=b, a<b, or b<a. 


(G) Ifa <bandb <c, thena < c. (The relation < is transitive.) 
(H) Ifa <b,thena+c <b-+c for any c, and if 0 <c, thenac < be. 


A field with an order relation satisfying (F)—(H) is an ordered field. Thus, the real 
numbers form an ordered field. The rational numbers also form an ordered field, but it is 
impossible to define an order on the field with two elements defined by (1.1.1) and (1.1.2) 
so as to make it into an ordered field (Exercise 1.1.2). 


We assume that you are familiar with other standard notation connected with the order 
relation: thus, a > b means that b < a; a > b means that eithera = bora >b;a<b 
means that either a = b ora < b; the absolute value of a, denoted by |a|, equals a if 
a > 0 or —a if a < 0. (Sometimes we call |a| the magnitude of a.) 


You probably know the following theorem from calculus, but we include the proof for 
your convenience. 
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Theorem 1.1.1 (The Triangle Inequality) Ifa andb are any two real numbers, 
then 
la + b| < Jal + |b]. (1.1.3) 


Proof There are four possibilities: 

(a) Ifa >Oandb > 0,thena+b>0,sola+b|=a+b=|a|+ |d|. 

(b) Ifa <Oandb <0, thena +b < 0,80 |a + b| = —a + (—b) = |a| + |dI. 

(c) Ifa >Oandb <0, thena +b = |a|— ||. 

(d) Ifa <0Oandb > 0, thena + b = —|a| + |b]. Eq. 1.1.3 holds in either case, since 


|a|—|b| if |a| > [>], 


: q 
|b|—|a| if |b] > lal, 


la + b| = 
The triangle inequality appears in various forms in many contexts. It is the most impor- 


tant inequality in mathematics. We will use it often. 


Corollary 1.1.2 [fa and b are any two real numbers, then 
la — b| = |la| — || (1.1.4) 


and 


la + b| = ||a| — [d)I. (1.1.5) 


Proof Replacing a by a — b in (1.1.3) yields 


a| < |a—b| + |b], 
so 

a—b| > |a|—|b|. (1.1.6) 
Interchanging a and b here yields 

b—a| > |b| —|al, 
which is equivalent to 

a—b| > |b|—|al, (1.1.7) 
since |b — a| = |a — b|. Since 

la|—|b| if al > |B, 
[lal — [el] = 


|b|—|a| if |b] > lal, 
(1.1.6) and (1.1.7) imply (1.1.4). Replacing b by —b in (1.1.4) yields (1.1.5), since |—b| = 
|b]. an 
Supremum of a Set 


A set S of real numbers is bounded above if there is a real number b such that x < b 
whenever x € S. In this case, b is an upper bound of S. If b is an upper bound of S, 
then so is any larger number, because of property (G). If B is an upper bound of S, but no 
number less than £ is, then 6 is a supremum of S, and we write 


ft re een | 
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With the real numbers associated in the usual way with the points on a line, these defini- 
tions can be interpreted geometrically as follows: b is an upper bound of S if no point of S 
is to the right of b; 6B = sup S if no point of S is to the right of f, but there is at least one 
point of S to the right of any number less than 6 (Figure 1.1.1). 


(S = dark line segments) 


Figure 1.1.1 


Example 1.1.1 If S is the set of negative numbers, then any nonnegative number is an 
upper bound of S, and sup S = 0. If S; is the set of negative integers, then any number a 
such that a > —1 is an upper bound of S;, and sup Sj = —1. | 


This example shows that a supremum of a set may or may not be in the set, since Sj 
contains its supremum, but S does not. 


A nonempty set is a set that has at least one member. The empty set, denoted by 9, is the 
set that has no members. Although it may seem foolish to speak of such a set, we will see 
that it is a useful idea. 


The Completeness Axiom 


It is one thing to define an object and another to show that there really is an object that 
satisfies the definition. (For example, does it make sense to define the smallest positive 
real number?) This observation is particularly appropriate in connection with the definition 
of the supremum of a set. For example, the empty set is bounded above by every real 
number, so it has no supremum. (Think about this.) More importantly, we will see in 
Example 1.1.2 that properties (A.)—(H) do not guarantee that every nonempty set that 
is bounded above has a supremum. Since this property is indispensable to the rigorous 
development of calculus, we take it as an axiom for the real numbers. 
(I) Ifanonempty set of real numbers is bounded above, then it has a supremum. 
Property (I) is called completeness, and we say that the real number system is a complete 
ordered field. It can be shown that the real number system is essentially the only complete 
ordered field; that is, if an alien from another planet were to construct a mathematical 
system with properties (A.)—(I), the alien’s system would differ from the real number 
system only in that the alien might use different symbols for the real numbers and +, -, 
and <. 


Theorem 1.1.3 /fanonempty set S of real numbers is bounded above, then sup S is 
the unique real number B such that 


(a) x <Bforallx in S; 


(b) if € > 0 (no matter how small), there is an xq in S such that x9 > B — €. 
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Proof We first show that 8 = sup S has properties (a) and (b). Since B is an upper 
bound of S, it must satisfy (a). Since any real number a less than B can be written as B —€ 
with ¢e = B —a > 0, (b) is just another way of saying that no number less than f is an 
upper bound of S. Hence, 6 = sup S satisfies (a) and (b). 

Now we show that there cannot be more than one real number with properties (a) and 
(b). Suppose that B; < B2 and B2 has property (b); thus, if ¢ > 0, there is an xo in S 
such that x9 > B2 — €. Then, by taking « = 62 — 1, we see that there is an xo in S such 
that 

Xo > B2 — (B2 — Bi) = Bi, 
so B; cannot have property (a). Therefore, there cannot be more than one real number 
that satisfies both (a) and (b). a 


Some Notation 


We will often define a set S by writing S = {x | veh which means that S consists of all 
x that satisfy the conditions to the right of the vertical bar; thus, in Example 1.1.1, 


Safe la 0} (1.1.8) 
and 
Sy; = {x | x is a negative integer} ; 


We will sometimes abbreviate “x is a member of S” by x € S, and “x is not a member of 
S” by x ¢ S. For example, if S is defined by (1.1.8), then 


-leS but O€S. 


The Archimedean Property 


The property of the real numbers described in the next theorem is called the Archimedean 
property. Intuitively, it states that it is possible to exceed any positive number, no matter 
how large, by adding an arbitrary positive number, no matter how small, to itself sufficiently 
many times. 


Theorem 1.1.4 (The Archimedean Property) If p and «€ are positive, then 
née > p for some integer n. 


Proof The proof is by contradiction. If the statement is false, p is an upper bound of 
the set 
S= {x | x =neé,nisan integer} . 


Therefore, S has a supremum 8, by property (I). Therefore, 


ne <f forall integers n. (1.1.9) 
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Since n + | is an integer whenever n is, (1.1.9) implies that 
(n+le <8 


and therefore 

ne < B—e 
for all integers n. Hence, 6 — € is an upper bound of S. Since B — € < 8, this contradicts 
the definition of f. q 


Density of the Rationals and Irrationals 


Definition 1.1.5 A set D is dense in the reals if every open interval (a, b) contains a 
member of D. 


Theorem 1.1.6 The rational numbers are dense in the reals ; that is, if a and b are 
real numbers witha < b, there is a rational number p/q such thata < p/q <b. 


Proof From Theorem 1.1.4 with p = 1 and « = b—a, there is a positive integer g such 
that g(b — a) > 1. There is also an integer j such that j > qa. This is obvious if a < 0, 
and it follows from Theorem 1.1.4 with e = 1 and p = ga ifa > 0. Let p be the smallest 
integer such that p > ga. Then p — 1 < qa, so 


qa<p<qa+l. 
Since 1 < q(b — a), this implies that 
qa<p<qa+t+q(b—a)=4qb, 
so qa < p < qb. Therefore, a < p/q <b. q 


Example 1.1.2 The rational number system is not complete; that is, a set of rational 
numbers may be bounded above (by rationals), but not have a rational upper bound less 
than any other rational upper bound. To see this, let 


S= {r | r is rational and r? < 2\ : 


Ifr ¢ S,thenr < J/2. Theorem 1.1.6 implies that if € > O there is a rational number ro 
such that /2—e« < ro < /2, so Theorem 1.1.3 implies that J2= sup S. However, V2 is 
irrational; that is, it cannot be written as the ratio of integers (Exercise 1.1.3). Therefore, 
if r, is any rational upper bound of S, then /2 < r;. By Theorem 1.1.6, there is a rational 
number rz such that J/2 < r2 <1 ,. Since rz is also a rational upper bound of S, this shows 
that S has no rational supremum. | 


Since the rational numbers have properties (A.)—(H), but not (I), this example shows 
that (I) does not follow from (A.)—(H). 


Theorem 1.1.7 The set of irrational numbers is dense in the reals ; that is, if a and b 
are real numbers witha < b, there is an irrational number t such thata <t <b. 
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Proof From Theorem 1.1.6, there are rational numbers 7; and rz such that 


a<ry<1r2 <b. (1.1.10) 
Let i 
t=rnt+ a —1}). 
Then ¢ is irrational (why?) andr, <t <7r2,soa <t <b, from (1.1.10). an] 


Infimum of a Set 


A set S of real numbers is bounded below if there is a real number a such that x > a 
whenever x € S. In this case, a is a lower bound of S. If a is a lower bound of S, so is 
any smaller number, because of property (G). If a is a lower bound of S, but no number 
greater than @ is, then a is an infimum of S, and we write 


a =infS. 
Geometrically, this means that there are no points of S to the left of a, but there is at least 
one point of S to the left of any number greater than a. 
Theorem 1.1.8 /fa nonempty set S of real numbers is bounded below, then inf S is 
the unique real number a such that 
(a) x >aforallx inS; 
(b) ife > 0 (no matter how small), there is an xo in S such that xp < a +€. 
Proof (Exercise 1.1.6) 


A set S is bounded if there are numbers a and b such thata < x < b forallxin S.A 
bounded nonempty set has a unique supremum and a unique infimum, and 


inf S < sup S$ (1.1.11) 
(Exercise 1.1.7). an] 


The Extended Real Number System 


A nonempty set S of real numbers is unbounded above if it has no upper bound, or un- 
bounded below if it has no lower bound. It is convenient to adjoin to the real number 
system two fictitious points, +-co (which we usually write more simply as oo) and —oo, 
and to define the order relationships between them and any real number x by 


—0 <x <oO. (1.1.12) 


We call co and —oo points at infinity. If S is a nonempty set of reals, we write 


sup S = co (1.1.13) 
to indicate that S is unbounded above, and 
inf S = —oo (1.1.14) 


to indicate that S is unbounded below. 
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Example 1.1.3 If 
S= {x | x < 2}, 


then sup S = 2 and inf S = —on. If 
S= {x | x > —2}, 


then sup S = oo and infS = —2. If S is the set of all integers, then sup S = oo and 
inf S = —oo. a 


The real number system with oo and —oo adjoined is called the extended real number 
system, or simply the extended reals. A member of the extended reals differing from —oo 
and oo is finite; that is, an ordinary real number is finite. However, the word “finite” in 
“finite real number” is redundant and used only for emphasis, since we would never refer 
to oo or —oo as real numbers. 


The arithmetic relationships among 00, —oo, and the real numbers are defined as follows. 


(a) Ifa is any real number, then 


a+o= ot+a= ~~, 
a—-wo=-ot+a=-a, 
a a 
—=— > ———>S = 0 
co ©6000 
(b) Ifa >0, then 
ao = wa = ~w, 
a (—co) = (—00) a = —00. 
(c) Ifa <0, then 
aco = wa =-~O, 
a(—o) =(-o)a= oO. 
We also define 
00 + CO = COOO = (—00)(—00) = C0 
and 
—00 — 00 = 00(—00) = (—00)00 = —0n. 
Finally, we define 
|co| = | — 00] = 00. 


The introduction of oo and —oo, along with the arithmetic and order relationships defined 
above, leads to simplifications in the statements of theorems. For example, the inequality 
(1.1.11), first stated only for bounded sets, holds for any nonempty set S if it is interpreted 
properly in accordance with (1.1.12) and the definitions of (1.1.13) and (1.1.14). Exer- 
cises 1.1.10(b) and 1.1.11(b) illustrate the convenience afforded by some of the arith- 
metic relationships with extended reals, and other examples will illustrate this further in 
subsequent sections. 
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It is not useful to define co — 00, 0- c0, oo/o0, and 0/0. They are called indeterminate 
forms, and left undefined. You probably studied indeterminate forms in calculus; we will 
look at them more carefully in Section 2.4. 


1.1 Exercises 


1. Write the following expressions in equivalent forms not involving absolute values. 
(a)a+b+|a—b| (b)a+b—|a—b| 
(c)at+b+2c+ |a—b|+|a+b—2c + |a—d|| 
(d)a+b+2c—|a—b|—|a+b-—2c-|a-bd| 

2. Verify that the set consisting of two members, 0 and 1, with operations defined by 


Eqns. (1.1.1) and (1.1.2), is a field. Then show that it is impossible to define an order 
< on this field that has properties (F), (G), and (H). 


3. Show that V2 is irrational. HINT: Show that if /2 = m/n, where m and n are 
integers, then both m and n must be even. Obtain a contradiction from this. 
4. Show that ./p is irrational if p is prime. 
5. Find the supremum and infimum of each S. State whether they are in S. 
(a) S = {x|x =—(1/n) + [1+ (-1)"]n?,n = 1} 
(b) 8 = {x |a7 <8} 
(c) S={x|x?<7} 
(d) S = {x||2x+1|<5} 
(e) S={x|(Q?41) 1 > 3} 
(f) S = {x |x = rational and x? < 7} 
6. Prove Theorem 1.1.8. HINT: The set T = {x | —xeE s\ is bounded above if S is 
bounded below. Apply property (1) and Theorem 1.1.3 to T. 
7. (a) Show that 


inf S < sup $ (A) 


for any nonempty set S' of real numbers, and give necessary and sufficient 
conditions for equality. 

(b) Show that if S is unbounded then (A) holds if it is interpreted according to 
Eqn. (1.1.12) and the definitions of Eqns. (1.1.13) and (1.1.14). 


8. Let S and T be nonempty sets of real numbers such that every real number is in S 
or T and ifs € S andt € T, then s < tf. Prove that there is a unique real number 6 
such that every real number less than 6 is in S and every real number greater than 
B is in T. (A decomposition of the reals into two sets with these properties is a 
Dedekind cut. This is known as Dedekind’s theorem.) 
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9. 


10. 


11. 


12. 


Using properties (A.)-(H) of the real numbers and taking Dedekind’s theorem 
(Exercise 1.1.8) as given, show that every nonempty set U of real numbers that is 
bounded above has a supremum. HINT: Let T be the set of upper bounds of U and 
S' be the set of real numbers that are not upper bounds of U. 


Let S and T be nonempty sets of real numbers and define 
S+T={s+t|seS,teT}. 
(a) Show that 


sup(S + 7) = sup S + supT (A) 
if S and T are bounded above and 
inf(S + T) = inf S + infT (B) 


if S and T are bounded below. 
(b) Show that if they are properly interpreted in the extended reals, then (A) and 
(B) hold if S and T are arbitrary nonempty sets of real numbers. 


Let S and T be nonempty sets of real numbers and define 
S-T={s-t|seS,teT}. 
(a) Show that if S and T are bounded, then 
sup(S — 7) = sup S — inf T (A) 
and 
inf(S — T) = inf S —supT. (B) 


(b) Show that if they are properly interpreted in the extended reals, then (A) and 
(B) hold if S and T are arbitrary nonempty sets of real numbers. 


Let S be a bounded nonempty set of real numbers, and let a and b be fixed real 
numbers. Define T = {as +b | ses ‘ Find formulas for sup T and inf T in terms 
of sup S and inf S. Prove your formulas. 


1.2 MATHEMATICAL INDUCTION 


If a flight of stairs is designed so that falling off any step inevitably leads to falling off the 
next, then falling off the first step is a sure way to end up at the bottom. Crudely expressed, 
this is the essence of the principle of mathematical induction: If the truth of a statement 
depending on a given integer 1 implies the truth of the corresponding statement with n 
replaced by m + 1, then the statement is true for all positive integers n if itis true forn = 1. 
Although you have probably studied this principle before, it is so important that it merits 
careful review here. 


Peano’s Postulates and Induction 


The rigorous construction of the real number system starts with a set N of undefined ele- 
ments called natural numbers, with the following properties. 


Section 1.2 Mathematical Induction 11 


(A) Nis nonempty. 

(B) Associated with each natural number 7 there is a unique natural number n’ called 
the successor of n. 

(C) There is a natural number 77 that is not the successor of any natural number. 

(D) Distinct natural numbers have distinct successors; that is, ifn 4m, then n’ 4m’. 


(E) The only subset of N that contains 7 and the successors of all its elements is N 
itself. 

These axioms are known as Peano’s postulates. The real numbers can be constructed 
from the natural numbers by definitions and arguments based on them. This is a formidable 
task that we will not undertake. We mention it to show how little you need to start with to 
construct the reals and, more important, to draw attention to postulate (E), which is the 
basis for the principle of mathematical induction. 

It can be shown that the positive integers form a subset of the reals that satisfies Peano’s 
postulates (with 7 = 1 andn’ = n + 1), and it is customary to regard the positive integers 
and the natural numbers as identical. From this point of view, the principle of mathematical 
induction is basically a restatement of postulate (E). 


Theorem 1.2.1 (Principle of Mathematical Induction) Let P;, P>,..., 
Py, ... be propositions, one for each positive integer, such that 


(a) P, is true; 
(b) for each positive integer n, Py implies Pn+1. 
Then Py is true for each positive integer n. 
Proof Let 
M = {n|n € Nand P, is true} . 
From (a), 1 € M, and from (b), » + 1 € M whenever n € M. Therefore, M = N, by 
postulate (E). a 


Example 1.2.1 Let P,, be the proposition that 
n(n + 1) 
es. 


Then P is the proposition that 1 = 1, which is certainly true. If P, is true, then adding 
n + 1 to both sides of (1.2.1) yields 


1+2+--+n= (1.2.1) 


n(n + 1) 
2 

(n + 1) (5 + 1) 

_ @+1)@+2) 

a an 


(4+24+--4+n)4+(n4+1)= + (+1) 


or 
(n + 1)(7 + 2) 


1424+--4+(@4+)D= ; 
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which is P,+1, since it has the form of (1.2.1), withn replaced by n+ 1. Hence, P, implies 
Pyii, so (1.2.1) is true for all n, by Theorem 1.2.1. | 


A proof based on Theorem 1.2.1 is an induction proof, or proof by induction. The 
assumption that P, is true is the induction assumption. (Theorem 1.2.3 permits a kind of 
induction proof in which the induction assumption takes a different form.) 


Induction, by definition, can be used only to verify results conjectured by other means. 
Thus, in Example 1.2.1 we did not use induction to find the sum 


Sp =1L14+24+---4+2; (e222) 
rather, we verified that 
nin+1 
wera : uy (1.2.3) 


How you guess what to prove by induction depends on the problem and your approach to 
it. For example, (1.2.3) might be conjectured after observing that 


1-2 2-3 4-3 
at era §2=3 = —_, a aa 


However, this requires sufficient insight to recognize that these results are of the form 
(1.2.3) for n = 1, 2, and 3. Although it is easy to prove (1.2.3) by induction once it has 
been conjectured, induction is not the most efficient way to find s,, which can be obtained 
quickly by rewriting (1.2.2) as 


So =n+(n—1)4+---4+1 
and adding this to (1.2.2) to obtain 
2sn = [n+ 1) +[(H—1) +2] 4+---+[1 +n]. 


There are n bracketed expressions on the right, and the terms in each add up ton + 1; 
hence, 

2s, = n(n + 1), 
which yields (1.2.3). 


The next two examples deal with problems for which induction is a natural and efficient 
method of solution. 


Example 1.2.2 Let a; = 1 and 


1 


mea >] 1.2.4 
a as n= ( ) 


ant+1 = 
(we say that ay, is defined inductively), and suppose that we wish to find an explicit formula 
for a,. By considering n = 1, 2, and 3, we find that 
1 ad 1 


=o, es. Gnd w= 
=k a a Teas 
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and therefore we conjecture that 
1 


nl 


in = (1.2.5) 


This is given form = 1. If we assume it is true for some n, substituting it into (1.2.4) yields 


1 1 1 


Sl aa al Gee 


which is (1.2.5) with n replaced by n + 1. Therefore, (1.2.5) is true for every positive 
integer n, by Theorem 1.2.1. 


Example 1.2.3 For each nonnegative integer n, let x, be a real number and suppose 
that 
Xnt1 —Xn| <7 |\Xn-—%n-1|], n=l, (1.2.6) 


where r is a fixed positive number. By considering (1.2.6) form = 1, 2, and 3, we find that 
x2 —x1| <r|x1 — Xol, 


x3 —X2| <r|xo—-—2x1| < r?|x1 — xo, 
x4 —X3| <r|x3— x2] <r3|x1— xol. 


Therefore, we conjecture that 
eta |S le | I ed (1.2.7) 
This is trivial forn = 1. If itis true for some n, then (1.2.6) and (1.2.7) imply that 
lxnt1 — nl <rQr""|x1—xol), 80 [xnt1 — Xn] <r" |x1 -xol, 


which is proposition (1.2.7) with n replaced by n + 1. Hence, (1.2.7) is true for every 
positive integer n, by Theorem 1.2.1. | 


The major effort in an induction proof (after P;, P2,..., Pn, ... have been formulated) 
is usually directed toward showing that P, implies P,4 1. However, it is important to verify 
P, since P, may imply Py+1 even if some or all of the propositions P;, P2,..., Pn, ... 
are false. 


Example 1.2.4 Let P, be the proposition that 2n — 1 is divisible by 2. If P, is true 
then P,+1 is also, since 
2n+1= (Qn-1)4+2. 


However, we cannot conclude that P, is true forn > 1. In fact, Py, is false forevery n. 


The following formulation of the principle of mathematical induction permits us to start 
induction proofs with an arbitrary integer, rather than 1, as required in Theorem 1.2.1. 
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Theorem 1.2.2 Let no be any integer (positive, negative, or zero). Let Pn, Pno+1, 
.., Py, ... be propositions, one for each integer n = no, such that 


(a) Pno is true ; 

(b) for each integer n => 10, Py implies Pn+1. 

Then P,, is true for every integern = no. 

Proof Form > 1, let Q» be the proposition defined by Qm = Pm+no—1- Then Qi = 
Pro is true by (a). If m > 1 and Om = Pm+no—1 is true, then Om+1 = Pmno is true by 
(b) withn replaced by m + no — 1. Therefore, Qm is true for all m > 1 by Theorem 1.2.1 


with P replaced by QO and n replaced by m. This is equivalent to the statement that P, is 
true for alln > no. an 


Example 1.2.5 Consider the proposition P,, that 
3n+ 16> 0. 
If P, is true, then so is Py,4+1, since 


3(n+1)+16=3n+3+4 16 
= (37 + 16) +3 > 0+ 3 (by the induction assumption) 
> 0. 


The smallest 19 for which Py, is true is m9 = —5. Hence, Py is true forn > —5, by 
Theorem 1.2.2. 


Example 1.2.6 Let P,, be the proposition that 
n!—3”" >0. 
If P,, is true, then 
(n+ 1)!-—3"*F! =n! + 1-377! 

> 3"(n +1) —3"*! (by the induction assumption) 

= 3"(n — 2). 
Therefore, P, implies Py+1 if n > 2. By trial and error, n9 = 7 is the smallest integer 
such that Py, is true; hence, P, is true forn > 7, by Theorem 1.2.2. | 


The next theorem is a useful consequence of the principle of mathematical induction. 


Theorem 1.2.3 Let no be any integer (positive, negative, or zero). Let Pno, Pno+1.---> 
Py, ... be propositions, one for each integer n > no, such that 


(a) Pno is true ; 
(b) forn = no, Pn+1 is true if Pao, Pno+1.---, Pn are all true. 


Then Py, is true forn = no. 
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Proof Forn > no, let Q, be the proposition that Pro» Pno+1>--+» Pn are all true. Then 
Ong is true by (a). Since Q, implies Py41 by (b), and Qn41 is true if Q, and P,+1 are 
both true, Theorem 1.2.2 implies that Q, is true for all n > no. Therefore, P, is true for 
alln > no. an 


Example 1.2.7 An integer p > 1 is a prime if it cannot be factored as p = rs where 
r and s are integers and 1 < r,s < p. Thus, 2, 3,5, 7, and 11 are primes, and, although 4, 
6, 8, 9, and 10 are not, they are products of primes: 


4=2-2, 6=2:-3, 8=2-2-2, 9=3-3, 10=2:-5. 


These observations suggest that each integer n > 2 is a prime or a product of primes. Let 
this proposition be P,. Then P 2 is true, but neither Theorem 1.2.1 nor Theorem 1.2.2 
apply, since P, does not imply P,+1 in any obvious way. (For example, it is not evident 
from 24 = 2 -2 -2 -3 that 25 is a product of primes.) However, Theorem 1.2.3 yields the 
stated result, as follows. Suppose that n > 2 and P2,..., Py are true. Eithern + lisa 
prime or 

n+1=rs, (1.2.8) 
where r and s are integers and | < r,s <n, so P, and Ps are true by assumption. Hence, r 
and s are primes or products of primes and (1.2.8) implies that n + 1 is a product of primes. 


We have now proved P,+4 1 (that m + 1 is a prime or a product of primes). Therefore, P, is 
true for all n > 2, by Theorem 1.2.3. 


1.2 Exercises 


Prove the assertions in Exercises |.2.1—1.2.6 by induction. 


1. The sum of the first 7 odd integers is n?. 


1)\(2 1 
2. (Pe? 4 pee EE 


6 
4n? —1 
43° 4.<.¢ 071% = ao 
4. Ifd,,da,..., dy are arbitrary real numbers, then 


lay +2 +-+++4n| < |ai| + |a2| +--+ + lanl. 
5. Ifa; >0,i > 1, then 
(1 +41)(1 +.42)-+-(1 + an) = 1 +a, +a2+-+-+ an. 
6. If0<a; <1,i > 1, then 


(=a) —a2)-*+(1 -a,) & 1 ay a2 *++ ap. 
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7. 
8. 


10. 


11. 


12. 


13. 


14. 


Suppose that so > O and s, = 1 —e~*"—!,n > 1. Show that 0 < sy <1,n>1. 


Suppose that R > 0, x9 > 0, and 


(5+) 
Xnt1 =>z(—+%), n=O. 
2\ Xn 


Prove: Forn > 1, X,7 > Xn41 > VR and 


Kyo ARS @o— VR 


1 
mee LL Xo 


Find and prove by induction an explicit formula for a, if a; = 1 and, forn > 1, 


an = 3an 
Qa Gepaay  — = GE HaWes) 
(c) an+1 = are Hl an (d) aAn+1 = (: + =) an 


Let ay = 0 and ay41 = (n + I)ay forn > 1, and let P, be the proposition that 
an =n! 

(a) Show that P, implies Py+1. 

(b) Is there an integer n for which P, is true? 


Let P, be the proposition that 


= (n + 2)(n — 1) 


14+2+---4+n 
2 


(a) Show that P, implies Py+1. 
(b) Is there an integer n for which P,, is true? 


For what integers n is 
1 8” 
—>—!? 
n! (2n)! 
Prove your answer by induction. 
Let a be an integer > 2. 
(a) Show by induction that if n is a nonnegative integer, then = ag + r, where 
q (quotient) and r (remainder) are integers and0 <r <a. 
(b) Show that the result of (a) is true if 7 is an arbitrary integer (not necessarily 
nonnegative). 
(c) Show that there is only one way to write a given integer 7 in the formn = 
aq +r, where q andr are integers and0 <r <a. 


Take the following statement as given: If p is a prime and a and b are integers such 
that p divides the product ab, then p divides a or b. 


15. 


16. 


17. 


18. 


19. 
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(a) Prove: If p, pi,..., Px are positive primes and p divides the product pi «++ px, 
then p = p; for some i in {1,..., kK}. 
(b) Let n be an integer > 1. Show that the prime factorization of n found in 
Example 1.2.7 is unique in the following sense: If 
N= pirs*Pr and n= q1ga---s, 


where j,..., Pr, G1,-++» Ys are positive primes, then r = s and {q1,...,q,7} 
is a permutation of {p1,..., Dr}. 


Let aj = az = 5 and 

anti = an+ 6dy-1, n=2. 
Show by induction that a, = 3” — (—2)” ifn > 1. 
Let a, = 2, a2 = 0, a3 = —14, and 


An+1 = 9a4n — 23dyn—-1 + 15an-2, 1 > 3. 
Show by induction that a, = 37-1_5r-140n> 1. 
The Fibonacci numbers {Fy}, are defined by Fi = Fy = 1 and 
Fn41 = Fn t+ Fa-i, n= 2. 
Prove by induction that 
Pe es ees 


F, 
n 5 = 


Prove by induction that 
1 | 
n! 
21. — yl dy = ————— 
I yU-y Y= Gane +2 G Fat) 
ifn is anonnegative integer and r > —1. 


: ; ; . ; n 
Suppose that m and n are integers, with 0 < m <n. The binomial coefficient ( 
m 
is the coefficient of t” in the expansion of (1 + ft)”; that is, 


d+n"= >> (7) 


m=0 


From this definition it follows immediately that 


For convenience we define 
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("\=(0)+(.t,). osmen 


and use this to show by induction on 7 that 


n n! oe 
= <m<n. 
m m\(n —m)! 


(a) Show that 


(b) Show that 


n n(n 7 n fe oe 
LY (") =0 and > (") = 2", 
(c) Show that 
(x+y)" = x cane 


(This is the binomial theorem.) 
20. Use induction to find an nth antiderivative of log x, the natural logarithm of x. 


21. Let fi(x1) = g1(%1) = 1. Forn > 2, let 


Pei Nock y ip) = hp Os A ee 


| fo—1(%1, X2,---,%n-1) — 2" ?xp| 
and 
Ba 1, Hap ix dyn) = Saari Fa,2045 Xa) +2” Xp — 
Bat i Rass ne nen) = 2 | 
Find explicit formulas for f,(x1, X2,..., Xn) and gn (x1, X2,...,Xn)- 
22. Prove by induction that 
: ; 4 1 —cos2nx 
sinx + sin3x +---+ sin(2n — 1)x = ————, n> 1. 
2sinx 


HINT: You will need trigonometric identities that you can derive from the identities 


cos(A — B) = cos Acos B + sin Asin B, 
cos(A + B) = cos Acos B — sin A sin B. 


Take these two identities as given. 
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23. Suppose that a; < a2 <---<ad, and by < by <--- < by. Let {€), fo,... ln} bea 
permutation of {1,2,...,}, and define 


O(l1, b2,....€n) = Y(aj — be). 
i=1 
Show that 
O(E1, £2,...,£n) = O(1,2,...,7). 


1.3 THE REAL LINE 


One of our objectives is to develop rigorously the concepts of limit, continuity, differen- 
tiability, and integrability, which you have seen in calculus. To do this requires a better 
understanding of the real numbers than is provided in calculus. The purpose of this section 
is to develop this understanding. Since the utility of the concepts introduced here will not 
become apparent until we are well into the study of limits and continuity, you should re- 
serve judgment on their value until they are applied. As this occurs, you should reread the 
applicable parts of this section. This applies especially to the concept of an open covering 
and to the Heine—Borel and Bolzano—Weierstrass theorems, which will seem mysterious at 
first. 


We assume that you are familiar with the geometric interpretation of the real numbers as 
points on a line. We will not prove that this interpretation is legitimate, for two reasons: (1) 
the proof requires an excursion into the foundations of Euclidean geometry, which is not 
the purpose of this book; (2) although we will use geometric terminology and intuition in 
discussing the reals, we will base all proofs on properties (A.)—(I) (Section 1.1) and their 
consequences, not on geometric arguments. 


Henceforth, we will use the terms real number system and real line synonymously and 
denote both by the symbol R; also, we will often refer to a real number as a point (on the 
real line). 


Some Set Theory 


In this section we are interested in sets of points on the real line; however, we will consider 
other kinds of sets in subsequent sections. The following definition applies to arbitrary 
sets, with the understanding that the members of all sets under consideration in any given 
context come from a specific collection of elements, called the universal set. In this section 
the universal set is the real numbers. 


Definition 1.3.1 Let S and T be sets. 


(a) S contains T, and we write S D T or T C S, if every member of T is also in S. In 
this case, T is a subset of S. 


(b) S—T isthe set of elements that are in S but not in T. 


(c) S equals T, and we write S = T, if S contains T and T contains S; thus, S = T if 
and only if S and T have the same members. 
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(d) S strictly contains T if S contains T but T does not contain S; that is, if every 
member of T is also in S, but at least one member of S is not in T (Figure 1.3.1). 


(e) The complement of S, denoted by S°, is the set of elements in the universal set that 
are notin S. 


(f) The union of S and T, denoted by S U T, is the set of elements in at least one of S 
and T (Figure 1.3.1(b)). 


(g) The intersection of S and T, denoted by S / T, is the set of elements in both S and 
T (Figure 1.3.1(c)). If SA T = @ (the empty set), then S and T are disjoint sets 
(Figure 1.3.1(d)). 


(h) A set with only one member xo is a singleton set, denoted by {xo}. 


S) GD 


SUT = shaded region 
(a) (b) 


CY) OC 


S T= shaded region SAT=©6 
(c) (d) 
Figure 1.3.1 


Example 1.3.1 Let 


S=(e|0ex <4), T = {x |0 <x <1 and x is rational} , 


and 
U= {x |0 <x < land x is irrational} . 


Then S D T and S D U, and the inclusion is strict in both cases. The unions of pairs of 
these sets are 


SUT=S, SUU=S, and TUU=S, 


and their intersections are 


SOT=T, SNU=U, and TOHU=8. 
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Also, 
S—-U=T and S-T=U. | 


Every set S contains the empty set %, for to say that 9 is not contained in S is to say that 
some member of 9 is not in S, which is absurd since 9 has no members. If S is any set, 
then 

(S°)° =S and SNS°=9. 


If S is a set of real numbers, then S U S° = R 


The definitions of union and intersection have generalizations: If F is an arbitrary col- 
lection of sets, then U { S | SEF is the set of all elements that are members of at least 
one of the sets in F , and 1 {Ss | SEF \ is the set of all elements that are members of every 
set in #. The union and intersection of finitely many sets S,, ..., S, are also written as 
jai Sk and (\z_, Sz. The union and intersection of an infinite sequence {S;,}?0, of sets 

. foe) Co 
are written as | )y—, Sx and (\g—, Sx. 


Example 1.3.2 If ¥ is the collection of sets 
Sp = {x|p<x<1+p}, 0<p<1/2, 
then 


|_J {Sp | So ¢ F} = {x|0 <x <3/2} and (){Sp|Sp¢ F} = {x|1/2<x<]}. 


Example 1.3.3 If, for each positive integer k, the set S; is the set of real numbers 
that can be written as x = m/k for some integer m, then (7, Sx is the set of rational 
numbers and (7, Sx is the set of integers. 


Open and Closed Sets 
If a and b are in the extended reals and a < b, then the open interval (a, b) is defined by 
(a,b) = {x|a<x <b}. 


The open intervals (a, oo) and (—oo, b) are semi-infinite if a and b are finite, and (—o0o, 00) 
is the entire real line. 


Definition 1.3.2 If xo is areal number and € > 0, then the open interval (x9 —€, xo +€) 
is an €-neighborhood of xo. If a set S contains an €-neighborhood of xo, then S' is a 
neighborhood of xo, and Xo is an interior point of S (Figure 1.3.2). The set of interior 
points of S is the interior of S, denoted by S°. If every point of S is an interior point (that 
is, S° = S), then S is open. A set S is closed if S° is open. 


22 Chapter 1 The Real Numbers 


S = four line segments 
X, = interior point of S 


Figure 1.3.2 


The idea of neighborhood is fundamental and occurs in many other contexts, some of 
which we will see later in this book. Whatever the context, the idea is the same: some defi- 
nition of “closeness” is given (for example, two real numbers are “close” if their difference 
is “small’”’), and a neighborhood of a point xo is a set that contains all points sufficiently 
close to Xo. 


Example 1.3.4 An open interval (a,b) is an open set, because if x9 € (a,b) and 
€ < min{xo — a,b — xo}, then 


(xo — €,X0 + €) C (a,D). 


The entire line R = (—oo, co) is open, and therefore @ (= R°) is closed. However, @ is 
also open, for to deny this is to say that 8 contains a point that is not an interior point, 
which is absurd because 8 contains no points. Since 8 is open, R (= 8°) is closed. Thus, 
R and 9 are both open and closed. They are the only subsets of IR with this property 
(Exercise 1.3.18). | 


A deleted neighborhood of a point Xo is a set that contains every point of some neigh- 
borhood of x9 except for x9 itself. For example, 


S= {x |0 < |x — xo <e} 
is a deleted neighborhood of x9. We also say that it is a deleted €-neighborhood of xo. 


Theorem 1.3.3 
(a) The union of open sets is open. 
(b) The intersection of closed sets is closed. 


These statements apply to arbitrary collections, finite or infinite, of open and closed sets. 


Proof (a) Let § be a collection of open sets and 
S=uU{G|Ge 8}. 


If xo € S, then x9 € Go for some Go in Y, and since Go is open, it contains some e€- 
neighborhood of xo. Since Go C S, this €-neighborhood is in S, which is consequently a 
neighborhood of x9. Thus, S is a neighborhood of each of its points, and therefore open, 
by definition. 

(b) Let ¥ be a collection of closed sets and T = N{F|F eF}. Then TS = 
U {Fe | Fe F (Exercise 1.3.7) and, since each F* is open, T° is open, from (a). There- 
fore, T is closed, by definition. 0 
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Example 1.3.5 If —co <a < b < ~, the set 
[a,b] = {x|a<x<b} 


is closed, since its complement is the union of the open sets (—oo, a) and (b, 00). We say 
that [a, b] is a closed interval. The set 


[a,b) = {x |a <x <b} 
is a half-closed or half-open interval if —oo < a < b < ov, as is 
(a,b] = {x|a<x <b}; 


however, neither of these sets is open or closed. (Why not?) Semi-infinite closed intervals 
are sets of the form 


[a,00) = {x|a <x} and (—oo,a] = {x |x = ah, 


where a is finite. They are closed sets, since their complements are the open intervals 
(—oo, a) and (a, oo), respectively. | 


Example 1.3.4 shows that a set may be both open and closed, and Example 1.3.5 shows 
that a set may be neither. Thus, open and closed are not opposites in this context, as they 
are in everyday speech. 


Example 1.3.6 From Theorem 1.3.3 and Example 1.3.4, the union of any collection of 
open intervals is an open set. (In fact, it can be shown that every nonempty open subset of 
R is the union of open intervals.) From Theorem 1.3.3 and Example 1.3.5, the intersection 
of any collection of closed intervals is closed. | 


It can be shown that the intersection of finitely many open sets is open, and that the 
union of finitely many closed sets is closed. However, the intersection of infinitely many 
open sets need not be open, and the union of infinitely many closed sets need not be closed 
(Exercises 1.3.8 and 1.3.9). 


Definition 1.3.4 Let S be a subset of R. Then 
(a) Xo is a limit point of S if every deleted neighborhood of xo contains a point of S. 


(b) xo is a boundary point of S if every neighborhood of x9 contains at least one point 
in S and one not in S. The set of boundary points of S is the boundary of S, denoted 
by 0S. The closure of S, denoted by S,is S = S UOS. 


(c) Xo is an isolated point of S if x9 € S and there is a neighborhood of xo that contains 
no other point of S. 


(d) Xo is exterior to S if xo is in the interior of S°. The collection of such points is the 
exterior of S. 


Example 1.3.7 Let § = (—oo, —1] U (1, 2) U {3}. Then 
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(a) The set of limit points of S is (—oo, —1] U [1, 2]. 

(b) oS = {-1,1,2,3}and S = (—oo, —1] U [1, 2] U {3}. 
(c) 3 is the only isolated point of S. 

(d) The exterior of S is (—1, 1) U (2,3) U (3, 0x). 


Example 1.3.8 Forn > 1, let 


1 1 = 
——.—]| and S=|[Ju. 
Essa = Ur 


II 


Then 

(a) The set of limit points of S is S U {0}. 

(b) aS = {x|x =Oorx = 1/n (n = 2)} and S = S U {0}. 
(c) S has no isolated points. 

(d) The exterior of S is 


a 1 1 1 
es [U (aes sa) u (3): 


Example 1.3.9 Let S be the set of rational numbers. Since every interval contains a 
rational number (Theorem 1.1.6), every real number is a limit point of S; thus, S=R. 
Since every interval also contains an irrational number (Theorem 1.1.7), every real number 
is a boundary point of S; thus 0S = R. The interior and exterior of S are both empty, and 
S has no isolated points. S is neither open nor closed. | 


The next theorem says that S is closed if and only if S = S (Exercise 1.3.14). 
Theorem 1.3.5 A set S is closed if and only if no point of S° is a limit point of S. 


Proof Suppose that S is closed and xp € S°. Since S° is open, there is a neighborhood 
of xo that is contained in S° and therefore contains no points of S. Hence, x9 cannot be a 
limit point of S. For the converse, if no point of S° is a limit point of S then every point in 
S° must have a neighborhood contained in S°. Therefore, S° is open and S is closed. 


Theorem 1.3.5 is usually stated as follows. 
Corollary 1.3.6 A set is closed if and only if it contains all its limit points. 


Theorem 1.3.5 and Corollary 1.3.6 are equivalent. However, we stated the theorem as 
we did because students sometimes incorrectly conclude from the corollary that a closed 
set must have limit points. The corollary does not say this. If S has no limit points, then the 
set of limit points is empty and therefore contained in S. Hence, a set with no limit points 
is closed according to the corollary, in agreement with Theorem 1.3.5. For example, any 
finite set is closed and so is an infinite set comprised entirely of isolated points, such as the 
set of integers. 
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Open Coverings 


A collection J€ of open sets is an open covering of a set S if every point in S is contained 
ina set H belonging to #; that is, if S C U {H | He eae 


Example 1.3.10 The sets 


= 


are covered by the families of open intervals 


1 1 
HK, = 1(: _ Wee + x) [0 <x< 1 , (N = positive integer), 
1 


N 
KH. : 
2= n -—n+e— 


n=12snf, 


1 1 
H3 = — ae rpm =1,2,...7, 
and 
H4 = {(0, p)|0< p< I, 
respectively. 


Theorem 1.3.7 (Heine—Borel Theorem) /f # is an open covering ofa closed 
and bounded subset S of the real line, then S has an open covering # consisting of finitely 
many open sets belonging to #. 


Proof Since S is bounded, it has an infimum @ and a supremum f, and, since S is 
closed, w and f belong to S (Exercise 1.3.17). Define 


S;= So [a,t] for t >a, 


and let 
F= {t | a <t < 6 and finitely many sets from # cover S;} j 


Since Sg = S, the theorem will be proved if we can show that B € F. To do this, we use 
the completeness of the reals. 


Since a € S, Sq is the singleton set {w}, which is contained in some open set Hy from 
# because # covers S; therefore, a € F. Since F is nonempty and bounded above by £, 
it has a supremum y. First, we wish to show that y = B. Since y < B by definition of F, 
it suffices to rule out the possibility that y < 6. We consider two cases. 
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CASE 1. Suppose that y < 6 and y ¢ S. Then, since S is closed, y is not a limit point 
of S (Theorem 1.3.5). Consequently, there is an € > O such that 


Iyv-e,yte NS =Q, 


so Sy_e = Sy+e. However, the definition of y implies that S,_. has a finite subcovering 
from #, while S,+. does not. This is a contradiction. 


CASE 2. Suppose that y < 6 and y € S. Then there is an open set H, in J€ that 
contains y and, along with y, an interval [y —€, y + €] for some positive €. Since S)_¢ has 
a finite covering {Hj,..., Hn} of sets from J, it follows that S$, has the finite covering 
{M,,..., Hn, H,}. This contradicts the definition of y. 


Now we know that y = 8, which is in S. Therefore, there is an open set Hg in # that 
contains 6 and along with 6, an interval of the form [6 — €, 8 + «], for some positive €. 
Since Sg_¢ is covered by a finite collection of sets {H,..., Hx}, Sg is covered by the 
finite collection {H1,..., Hx, Hg}. Since Sg = S, we are finished. q 


Henceforth, we will say that a closed and bounded set is compact. The Heine—Borel 
theorem says that any open covering of a compact set S contains a finite collection that 
also covers S. This theorem and its converse (Exercise 1.3.21) show that we could just 
as well define a set S' of reals to be compact if it has the Heine—Borel property; that is, if 
every open covering of S contains a finite subcovering. The same is true of R”, which we 
study in Section 5.1. This definition generalizes to more abstract spaces (called topological 
spaces) for which the concept of boundedness need not be defined. 


Example 1.3.11 Since S; in Example 1.3.10 is compact, the Heine-Borel theorem 
implies that S; can be covered by a finite number of intervals from J€;. This is easily veri- 
fied, since, for example, the 2N intervals from J; centered at the points x, = k/2N (0 < 
k <2N — 1) cover Sj. 

The Heine—Borel theorem does not apply to the other sets in Example 1.3.10 since they 
are not compact: S2 is unbounded and $3 and S¥4 are not closed, since they do not contain 
all their limit points (Corollary 1.3.6). The conclusion of the Heine—Borel theorem does 
not hold for these sets and the open coverings that we have given for them. Each point in 
S is contained in exactly / one set from #2, so removing even one of these sets leaves a 
point of Sz uncovered. If #€3 is any finite collection of sets from 43, then 


~ ¢U{H|H © Hs} 


for n sufficiently large. Any finite collection {(0, 1), ..., (0, Pn)} from #4 covers only the 
interval (0, Pmax), Where 


Pmax = Max{p1,..., Pn} <1. 


The Bolzano—Weierstrass Theorem 


As an application of the Heine—Borel theorem, we prove the following theorem of Bolzano 
and Weierstrass. 
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Theorem 1.3.8 (Bolzano—Weierstrass Theorem) Every bounded infinite set 
of real numbers has at least one limit point. 


Proof We will show that a bounded nonempty set without a limit point can contain only 
a finite number of points. If S has no limit points, then S is closed (Theorem 1.3.5) and 
every point x of S has an open neighborhood N,, that contains no point of S' other than x. 
The collection 

H = {Nx | x eS} 


is an open covering for S. Since S is also bounded, Theorem 1.3.7 implies that S can be 
covered by a finite collection of sets from #, say Nx,,..., Nx, Since these sets contain 
only x1, ..., Xn from S, it follows that S = {x1,..., Xn}. an 


1.3 Exercises 


1. FindSOT,(SNT)°,S°NT*°,SUT,(S UT)‘, and S° UT®. 
(a) S=(0,1),T =[$.3] (b) S = {x|x? > 4}, T = {x |x? < 9} 
(c) S = (-c0,0), T=0 (d)S = (-oo,-1), T = (1,00) 

2. Let S$, = (—-1/k,24+1/k],k = 1. Find 
@USs OAs ©US Mls 

k=1 k=1 k=1 k=1 

3. Prove: If A and B are sets and there is a set X such that AU X = BUX and 

AN X =BNX,thenA = B. 


4. Find the largest € such that S contains an €-neighborhood of xo. 
(a)xo= 75 =[3.1)  (b) 0 = 3,5 =[3,5] 
(c) x» = 5,8 =(-1,00) (d) x0 =1,5 = (0,2) 
5. Describe the following sets as open, closed, or neither, and find S 7 (S ey and 
(S°)*. 
(a) S = (—1,2)U[B,o0) =(b) S = (—0v, 1) U (2, 00) 
(c) S = [-3,-2] U[7,8] (d) S = {x |x = integer} 
6. Prove that (SN T)° = S° UT* and (SUT)® = SSN T®. 
7. Let & beacollection of sets and define 


I=N{F|FeF} and U=U{F|FeF}. 


Prove that (a) 1° = U{F°| F ¢ ¥} and (b) US = {NF°| F € F}. 


8. (a) Show that the intersection of finitely many open sets is open. 
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10. 


11. 


12. 
13. 
14. 


15. 


16. 
17. 
18. 
19. 


20. 
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(b) Give an example showing that the intersection of infinitely many open sets 
may fail to be open. 

(a) Show that the union of finitely many closed sets is closed. 

(b) Give an example showing that the union of infinitely many closed sets may 
fail to be closed. 

Prove: 

(a) IfU isa neighborhood of xo and U C V, then V is a neighborhood of xo. 

(b) IfU,,..., Un are neighborhoods of xo, so is (\;_, Uj. 

Find the set of limit points of S, 0S, 'S, the set of isolated points of S, and the 

exterior of S. 

(a) S = (—oo, —2) U (2, 3) U {4} U7, 00) 

(b) S = {all integers} 

(c) S=Uf{(n,n +1)|n = integer} 

(A) S45 [a= Tn at23.. 3 

Prove: A limit point of a set S is either an interior point or a boundary point of S. 

Prove: An isolated point of S is a boundary point of S°. 

Prove: 

(a) A boundary point of a set S is either a limit point or an isolated point of S. 

(b) A set S is closed if and only if S = S. 


Prove or disprove: A set has no limit points if and only if each of its points is 
isolated. 


(a) Prove: If S is bounded above and 6 = sup S, then B € 0S. 

(b) State the analogous result for a set bounded below. 

Prove: If S is closed and bounded, then inf S and sup S are both in S. 

If a nonempty subset S of R is both open and closed, then S = R. 

Let S be an arbitrary set. Prove: (a) 0S is closed. (b) S° is open. (c) The exterior 
of S is open. (d) The limit points of S form a closed set. (e) (5) =. 

Give counterexamples to the following false statements. 

(a) The isolated points of a set form a closed set. 

(b) Every open set contains at least two points. 

(c) If S; and S> are arbitrary sets, then 0(S1 U S2) = 0S, UdS2. 

(d) If S; and S> are arbitrary sets, then 0(S1 9 S2) = 0S, 1 0S>. 

(e) The supremum of a bounded nonempty set is the greatest of its limit points. 
(f) If S is any set, then 0(0S) = 0S. 

(g) If S is any set, then 0S = 0S. 

(hh) If S; and S> are arbitrary sets, then ($1 U S2)° = SPU SS. 


21. 


22. 


23. 


24. 
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Let S be a nonempty subset of R such that if #f is any open covering of S,, then S 
has an open covering Jf comprised of finitely many open sets from #. Show that 
S' is compact. 

Aset Sis.inaset TifS CT CS. 


(a) Prove: If S and T are sets of real numbers and S C T, then S is dense in T 
if and only if every neighborhood of each point in T contains a point from S. 

(b) State how (a) shows that the definition given here is consistent with the re- 
stricted definition of a dense subset of the reals given in Section 1.1. 


Prove: 

(a) (S1 N S2)° = Sy ial se (b) ST U se C (S$; U S2)° 
Prove: 

(a) 0(S1 U Sz) C 0S; UAS2 (b) a(S) N Sz) C AS; UIS2 
(c) aS Cas (d) aS = 0S¢ 


(e) a(S —T) C AS UAT 


CHAPTER 2 


Differential Calculus of 


Functions of One Variable 


IN THIS CHAPTER we study the differential calculus of functions of one variable. 


SECTION 2.1 introduces the concept of function and discusses arithmetic operations on 
functions, limits, one-sided limits, limits at too, and monotonic functions. 


SECTION 2.2 defines continuity and discusses removable discontinuities, composite func- 
tions, bounded functions, the intermediate value theorem, uniform continuity, and addi- 
tional properties of monotonic functions. 


SECTION 2.3 introduces the derivative and its geometric interpretation. Topics covered in- 
clude the interchange of differentiation and arithmetic operations, the chain rule, one-sided 
derivatives, extreme values of a differentiable function, Rolle’s theorem, the intermediate 
value theorem for derivatives, and the mean value theorem and its consequences. 


SECTION 2.4 presents a comprehensive discussion of L’ Hospital’s rule. 
SECTION 2.5 discusses the approximation of a function f by the Taylor polynomials of 


f and applies this result to locating local extrema of f. The section concludes with the 
extended mean value theorem, which implies Taylor’s theorem. 


2.1 FUNCTIONS AND LIMITS 


In this section we study limits of real-valued functions of a real variable. You studied 
limits in calculus. However, we will look more carefully at the definition of limit and prove 
theorems usually not proved in calculus. 


Atule f that assigns to each member of a nonempty set D a unique member of a set Y 
is a function from D to Y. We write the relationship between a member x of D and the 
member y of Y that f assigns to x as 


y = f(x). 


The set D is the domain of f, denoted by D ¢. The members of Y are the possible values 
of f. If yo € Y and there is an x9 in D such that f(xo) = yo then we say that f attains 
30 
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or assumes the value yo. The set of values attained by f is the range of f. A real-valued 
function of a real variable is a function whose domain and range are both subsets of the 
reals. Although we are concerned only with real-valued functions of a real variable in this 
section, our definitions are not restricted to this situation. In later sections we will consider 
situations where the range or domain, or both, are subsets of vector spaces. 


Example 2.1.1 The functions f, g, and / defined on (—oo, 00) by 
f(x) =x’, g(x) =sinx, and h(x) =e* 
have ranges [0, 00), [—1, 1], and (0, oo), respectively. 
Example 2.1.2 The equation 
foOres (2.1.1) 


does not define a function except on the singleton set {0}. If x < 0, no real number satisfies 
(2.1.1), while if x > 0, two real numbers satisfy (2.1.1). However, the conditions 


[f(@)P =x and f(x) 20 
define a function f on Dy = [0, 00) with values f(x) = ./x. Similarly, the conditions 
[g(x)? =x and g(x) <0 


define a function g on Dg = [0, 00) with values g(x) = —./x. The ranges of f and g are 
[0, co) and (—oo, 0], respectively. a 


It is important to understand that the definition of a function includes the specification 
of its domain and that there is a difference between f , the name of the function, and f(x), 
the value of f at x. However, strict observance of these points leads to annoying verbosity, 
such as “the function f with domain (—oo, oo) and values f(x) = x.” We will avoid this 
in two ways: (1) by agreeing that if a function f is introduced without explicitly defining 
Dy, then Dy will be understood to consist of all points x for which the rule defining 
Ff (x) makes sense, and (2) by bearing in mind the distinction between f and f(x), but not 
emphasizing it when it would be a nuisance to do so. For example, we will write “consider 
the function f(x) = V1 — x?,” rather than “consider the function f defined on [—1, 1] 
by f(x) = V1—x?,” or “consider the function g(x) = 1/ sinx,” rather than “consider 
the function g defined for x #4 ka (k = integer) by g(x) = 1/sinx.” We will also write 
f = (constant) to denote the function f defined by f(x) = c for all x. 


Our definition of function is somewhat intuitive, but adequate for our purposes. More- 
over, it is the working form of the definition, even if the idea is introduced more rigorously 
to begin with. For a more precise definition, we first define the Cartesian product X x Y 
of two nonempty sets X and Y to be the set of all ordered pairs (x, y) such that x € X and 
y € Y; thus, 

XxY = {(x,y)|xeX,yeY}. 
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A nonempty subset f of X x Y is a function if no x in X occurs more than once as a first 
member among the elements of f. Put another way, if (x, y) and (x, y;) are in f, then 
y = y,. The set of x’s that occur as first members of f is the of f. If x is in the domain 
of f, then the unique y in Y such that (x,y) € f is the value of f at x, and we write 
y = f(x). The set of all such values, a subset of Y, is the range of f. 


Arithmetic Operations on Functions 


Definition 2.1.1If De ND, # @, then f +g, f—g, and fg are defined on De N Dg 
by 


(f + g(x) = f(x) + g(x), 
(f — g)(x) = f(x) — g(x), 
and 


(fg)(x) = f(x)g(x). 
The quotient f/g is defined by 


for x in D¢ N Dg such that g(x) £ 0. 


Example 2.1.3 If f(x) = V4—x? and g(x) = Vx —1, then De = [—2,2] and 
Dz = (1,0), so f +g, f — g, and fg are defined on D¢ N Dg = [1, 2] by 
(f + 8)) = v4—-x?+vx-1, 
(f - g(x) = V4—x2 - Vx=I, 
and 
(fa)@) = (V4 —x?)(Vx — 1) = V¥(4— x7) — 1). (2.1.2) 
The quotient f/g is defined on (1, 2] by 


(Loo 
g x-1 


Although the last expression in (2.1.2) is also defined for —oo < x < —2, it does not 
represent fg for such x, since f and g are not defined on (—oo, —2]. 


Example 2.1.4 Ifc is areal number, the functionc f defined by (cf )(x) = cf (x) can 
be regarded as the product of f and a constant function. Its domain is D ¢. The sum and 
product of n (= 2) functions fi, ..., f, are defined by 


(Ait fate + fa)@) = A) + fale) +++ fax) 
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and 
(fi fas: fn)(x) = fi) fox) +++ fn) (2.1.3) 


on D = ();_, Dy,, provided that D is nonempty. If fj = f2 = +--+ = fn, then (2.1.3) 
defines the nth power of f: 
(f")) = (F(@))”. 


From these definitions, we can build the set of all polynomials 
D(X) = 4g + ayx +--+ anx", 


starting from the constant functions and f(x) = x. The quotient of two polynomials is a 
rational function 
ao +ayx +++ + dyx” 


Se : 
re) bo + byx +++++ bmx™ ene 


The domain of 7 is the set of points where the denominator is nonzero. 


Limits 


The essence of the concept of limit for real-valued functions of a real variable is this: If L 
is a real number, then lim,_,x, {(x) = L means that the value f(x) can be made as close 
to L as we wish by taking x sufficiently close to x9. This is made precise in the following 
definition. 


Figure 2.1.1 
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Definition 2.1.2 We say that f(x) approaches the limit L as x approaches xo, and 
write 


lim f(x) = L, 
X>X0Q 


if f is defined on some deleted neighborhood of xo and, for every € > 0, there is ad > 0 
such that 
| f(x) -—L| <e (2.1.4) 
if 
0 < |x-—xo| <6. (2.1.5) 
Figure 2.1.1 depicts the graph of a function for which lim,-,;. f(x) exists. 


Example 2.1.5 Ifc and x are arbitrary real numbers and f(x) = cx, then 
lim f(x) =cxp. 
X>X0O 


To prove this, we write 


| f(x) — exo] = |cx — cxo| = |c||x — xo. 
If c ¥ 0, this yields 
| f(x) — cxo| <€ (2.1.6) 
if 
|x —Xo| <4, 


where 6 is any number such that 0 < 6 < €/|c|. Ifc = 0, then f(x) —cxo = 0 for all x, 
so (2.1.6) holds for all x. | 


We emphasize that Definition 2.1.2 does not involve f(xo), or even require that it be 
defined, since (2.1.5) excludes the case where x = Xo. 


Example 2.1.6 If 
1 
f(x) =xsin-, x 40, 
x 
then 
lim f(x) =0 
x0 
even though f is not defined at x9 = 0, because if 
0< |x| <6 =e, 
then 
| f(x) — 0] = 


On the other hand, the function 


1 
x sin—| < |x| <e. 
x 


1 
g(x) =sin—, x40, 
x 


has no limit as x approaches 0, since it assumes all values between —1 and 1 in every 
neighborhood of the origin (Exercise 2.1.26). i) 
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The next theorem says that a function cannot have more than one limit at a point. 


Theorem 2.1.3 Iflim,— x. f(x) exists, then it is unique ; that is, if 


lim f(x)=L 1 and lim f(x) = Lo, Cag 
X>x0 X>X0 
then L; = Lo. 


Proof Suppose that (2.1.7) holds and let ¢ > 0. From Definition 2.1.2, there are positive 
numbers 5; and 62 such that 


|f(x)-Lil<e if O<|x—xo|<46;, i =1,2. 
If 5 = min(6,, 62), then 


[Ly — Lo| = |Li — f(x) + f(x) — L2| 
<|Ly — f(x)| + | f(x) — L2] <2e if O0< |x—-—x0| <6. 


We have now established an inequality that does not depend on x; that is, 
|Ly —La| < 2e. 
Since this holds for any positive €, L1 = Lo. an 
Definition 2.1.2 is not changed by replacing (2.1.4) with 
| f(x) —L| < Ke, (2.1.8) 


where K is a positive constant, because if either of (2.1.4) or (2.1.8) can be made to hold 
for any € > O by making |x — xo| sufficiently small and positive, then so can the other 
(Exercise 2.1.5). This may seem to be a minor point, but it is often convenient to work with 
(2.1.8) rather than (2.1.4), as we will see in the proof of the following theorem. 


A Useful Theorem about Limits 


Theorem 2.1.4 /f 


lim f(x)=L;1 and lim g(x) = Ly, (2.1.9) 
x>xo X>X0 
then 
im (f +g)(x) = 114+ Lo, (2.1.10) 
x0 
lim (f — g)(x) = Li — La, (2.1.11) 
x—>X0O 
lim (fg)(x) = LiLo, (2.1.12) 
xX>XO 
and, if Lz # 0, (2.1.13) 


lim (4) (x) = =i (2.1.14) 
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Proof From (2.1.9) and Definition 2.1.2, if € > 0, there is a 5; > 0 such that 
Fi) =ta| << (2.1.15) 
if 0 < |x — x9| < 61, and a 62 > 0 such that 
lg(x) — L2| <€ (2.1.16) 
if 0 < |x — xo| < 52. Suppose that 
0 < |x — xo| < 6 = min(6,, 52), (2.1.17) 
so that (2.1.15) and (2.1.16) both hold. Then 


I(f = g)(x) — (Li = L2)| = |(f(&) — £1) = (g(x) — L2)| 
=|7@)=L1| + |g@) = Ll < Ze, 


which proves (2.1.10) and (2.1.11). 
To prove (2.1.12), we assume (2.1.17) and write 


|(fg)@) — LiLa| = |f@)gx) — Li Lal 
= | f(x)(g(x) — Lo) + Lo(f(x) — L1)| 
<= |f@)le@) — Lol + |Lall f@) - Lil 
< (| f(x)| + |L2)e (from (2.1.15) and (2.1.16)) 
<= (FG) — Lil + [Lil + [Lape 
<(e + |Ly|+|Lo2\e from (2.1.15) 
<1 + [Lil + [Zale 


if € < | and x satisfies (2.1.17). This proves (2.1.12). 


To prove (2.1.14), we first observe that if Lz 4 0, there is a 63 > 0 such that 
|L| 
lg(x) — L2| < 3 


NO) 
|L2| 


lg(x)| > a (2.1.18) 


if 
0< |x — Xo| < 63. 
To see this, let L = Lz ande = |L2|/2 in (2.1.4). Now suppose that 


0 < |x — xo| < min(61, 52, 43), 


so that (2.1.15), (2.1.16), and (2.1.18) all hold. Then 
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(Qo ele 
g L2 g(x) Le 
_ [La f(x) = Lig@)| 
Ig(x)L2| 
2 
< pple fe) ~ Lig(x) 
2 
= Tape (E2lf) — bil + Lille — ll (from (2.1.18)) 
2 
= Lye lel fC) — Lal + |LrllL2 — all 
< zs (Lo) +|Lilje (from (2.1.15) and (2.1.16)). 
L2|? 
This proves (2.1.14). an] 


Successive applications of the various parts of Theorem 2.1.4 permit us to find limits 
without the «-é arguments required by Definition 2.1.2. 


Example 2.1.7 Use Theorem 2.1.4 to find 
9 — x? 


and = lim(9 — x”)(x + 1). 
x2 


Solution If c is a constant, then lim,—... c = c, and, from Example 2.1.5, lim; x. x = 
Xo. Therefore, from Theorem 2.1.4, 


lim (9 — x”) = lim 9 — lim x” 
x2 x72 x72 


= lim 9 — (li 2 
Lara 
=9-27 =5, 
and 
lim (x +1) = limx + lim 1 =24+1=3. 
x2 x2 x>2 
Therefore, 
Gas lim (9 — x”) 5 
lim = aa 
x72 x+1 lim (x + 1) 3 
x72 
and 


lim (9 — x?)(x + 1) = lim(9 — x”) lim(x + 1) = 5-3 = 15. | 
x72 x72 x72 


One-Sided Limits 


The function 


f(x) = 2x sin ./x 
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satisfies the inequality 


If@| <e 


if0 < x < 6 = €/2. However, this does not mean that limy.9 f(x) = 0, since f is 
not defined for negative x, as it must be to satisfy the conditions of Definition 2.1.2 with 
Xo = Oand L = 0. The function 


x 
ee) =x Al x #0, 
can be rewritten as 
x+1, x>0, 
g(x) = 


x-1, x<0; 


hence, every open interval containing x9 = 0 also contains points x; and x2 such that 
|g(x1) — g(x2)| is as close to 2 as we please. Therefore, lim,—+x, g(x) does not exist 
(Exercise 2.1.26). 

Although f(x) and g(x) do not approach limits as x approaches zero, they each exhibit 


a definite sort of limiting behavior for small positive values of x, as does g(x) for small 
negative values of x. The kind of behavior we have in mind is defined precisely as follows. 


> xX 


lim f@=h lim  f@=u 


x7 Xy x7 xX) + 
Figure 2.1.2 


Definition 2.1.5 


(a) We say that f(x) approaches the left-hand limit L as x approaches Xo from the left, 
and write 


lim f(x)=L, 
xXx>XQ—- 


if f is defined on some open interval (a, x9) and, for each € > 0, there isa dé > 0 
such that 
|f(x)-Ll <e if x9-b <x < Xp. 
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(b) We say that f(x) approaches the right-hand limit L as x approaches xo from the 
right, and write 


li =L 
a FO) ; 


if f is defined on some open interval (xo, b) and, for each €« > 0, there is ad > 0 
such that 
|[f(x)-Ll <e if x9<x<x9 +6. a 


Figure 2.1.2 shows the graph of a function that has distinct left- and right-hand limits at 
a point Xo. 


Example 2.1.8 Let 
x 
fa=—., x0. 
[| 
If x < 0, then f(x) = —x/x = —1, so 
lim f(x) =-1. 
If x > 0, then f(x) = x/x = 1, so 


a. I) ae 


Example 2.1.9 Let 


1 1 
yar oe 
De x 
If x < 0, then 
1 
g(x) = —xsin-, 
Bs 
so 
lim g(x) =0, 
x—0-— 
since ; 
|g(x) —O| = |x sin—| < |x| <e 
x 


if —e < x < 0; that is, Definition 2.1.5(a) is satisfied with 6 = ¢. If x > 0, then 


g(x) = (2+ x) sin z 
x 


which takes on every value between —2 and 2 in every interval (0, 5). Hence, g(x) does not 
approach a right-hand limit at x approaches 0 from the right. This shows that a function 
may have a limit from one side at a point but fail to have a limit from the other side. 
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Example 2.1.10 We leave it to you to verify that 


lim xsin /x = 0, 
x—>0+ 
and lim,_,o— sin ,/x does not exist. | 


Left- and right-hand limits are also called one-sided limits. We will often simplify the 
notation by writing 


Pte f(x) = f(xo—) and Pe F(x) = f(xo+). 


The following theorem states the connection between limits and one-sided limits. We 
leave the proof to you (Exercise 2.1.12). 


Theorem 2.1.6 A function f has a limit at xo if and only if it has left- and right-hand 
limits at X9, and they are equal. More specifically, 


ae 
if and only if 
f(xot) = f(xo-) = L. 


With only minor modifications of their proofs (replacing the inequality 0 < |x —xo| <6 
by x9 —6 < x < x9 Or X09 < X < Xo + 5), it can be shown that the assertions of Theo- 
rems 2.1.3 and 2.1.4 remain valid if “lim,—.,,.” is replaced by “limy—+x)—” or “limy—>x94” 
throughout (Exercise 2.1.13). 


Limits at +oo 


Limits and one-sided limits have to do with the behavior of a function f near a limit point 
of D 7. Itis equally reasonable to study f for large positive values of x if D ¢ is unbounded 
above or for large negative values of x if D ¢ is unbounded below. 


Definition 2.1.7 We say that f(x) approaches the limit L as x approaches oo, and 
write 


lim f(x) =L, 
xXxOoO 
if f is defined on an interval (a, oo) and, for each € > 0, there is a number f such that 


| f(x) —L] <e if x>f. | 
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Figure 2.1.3 provides an illustration of the situation described in Definition 2.1.7. 


Figure 2.1.3 


We leave it to you to define the statement “limy——o. f(x) = L” (Exercise 2.1.14) and 
to show that Theorems 2.1.3 and 2.1.4 remain valid if xo is replaced throughout by oo or 
—oo (Exercise 2.1.16). 


Example 2.1.11 Let 


1 2 
f@)=1-3, sx) = EL, and A(x) = sinx. 
Then 
lim f(x) = 1, 
x—0CoO 
since 
if@)-W=4<e if 
x)-ll=—<e if x>—, 
x2 Je 
and 
lim g(x) =2, 
x—oo 
since 
eG | a ee ee 
x)—-2\/= —2|/= <— if x>-. 
e 1+x l+x x € 


However, lim,.-+99 (x) does not exist, since / assumes all values between —1 and 1 in any 
semi-infinite interval (tT, 00). 

We leave it to you to show that limy+-. f(x) = 1, limy+-. g(x) = —2, and 
lim,,-+—o9 A(x) does not exist (Exercise 2.1.17). | 
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We will sometimes denote limy—oo f(x) and limy+-oo f(x) by f(co) and f(—oo), 
respectively. 


Infinite Limits 


The functions 


1 1 1 
f@=-, s@)= 5, pl) =sin-, 
XxX xX XxX 


and 


1 1 
q(x) = = sin= 
x x 


do not have limits, or even one-sided limits, at x9 = 0. They fail to have limits in different 
ways: 


e f(x) increases beyond bound as x approaches 0 from the right and decreases beyond 
bound as x approaches 0 from the left; 


e g(x) increases beyond bound as x approaches zero; 
e p(x) oscillates with ever-increasing frequency as x approaches zero; 


e g(x) oscillates with ever-increasing amplitude and frequency as x approaches 0. 


The kind of behavior exhibited by f and g near x9 = 0 is sufficiently common and 
simple to lead us to define infinite limits. 


Definition 2.1.8 We say that f(x) approaches oo as x approaches xo from the left, 
and write 
lim f(x)=0o or f(x9—-) =v, 
xXx>XQ—- 
if f is defined on an interval (a, x9) and, for each real number M, there is ad > 0 such 
that 
f(x)>M if x -8 <x < Xx. 


Example 2.1.12 We leave it to you to define the other kinds of infinite limits (Exer- 
cises 2.1.19 and 2.1.21) and show that 


lim — =—o, lim —=o; 
x->0- XxX x>0+ Xx 
. : 1 nd 
lim —= lim —= lim—~=o; 

x>0- x2 x9 04+ x2 x0 x? 
lim x? = lim x? =o; 
X00 x —00 

and 

lim x? = oO, lim x? = —oo. | 


x—>0Oo x—>—0O 
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Throughout this book, “lim, +x. /(x) exists” will mean that 


lim f(x) =L, where L is finite. 
x>X0 


To leave open the possibility that L = too, we will say that 


lim f(x) exists in the extended reals. 
X>XO 


This convention also applies to one-sided limits and limits as x approaches too. 


We mentioned earlier that Theorems 2.1.3 and 2.1.4 remain valid if “limx— x,” is re- 
placed by “lim, )—” or “limy-+x)4.” They are also valid with xo replaced by oo. 
Moreover, the counterparts of (2.1.10), (2.1.11), and (2.1.12) in all these versions of The- 
orem 2.1.4 remain valid if either or both of L; and Lo are infinite, provided that their 
right sides are not indeterminate (Exercises 2.1.28 and 2.1.29). Equation (2.1.14) and its 
counterparts remain valid if Lj /L2 is not indeterminate and Ly # 0 (Exercise 2.1.30). 


Example 2.1.13 Results like Theorem 2.1.4 yield 


e~—e * 1 
lim sinhx = lim —{—S— = = ( lim e* — lim e*) 
x—>0o x—00 oJ 2 \x>00 x00 
1 
= ~(3~O —-0) =~, 
5/ ) 
X_ p-x 1 
lim sinhx = lim “~*~ = = ( lim e*— lim e*) 
x—>—0o x—>—00 2 2 \x->-00 x—>—00 
= =(0—w) = -o, 
and 
Oe ee 
lim — = — =—=0 
x—>0o Xx lim x oe) 
x00 
Example 2.1.14 If 
f(x) = e* —e%*, 


we cannot obtain lim, +o. f(x) by writing 
lim f(x) = lim e?* — lim e*, 
x—-0oO x—-0oO x—0O 
because this produces the indeterminate form oo — oo. However, by writing 


f(x) = e**(1-e™), 


we find that 


lim f(x) = (Jim e?*) ( lim 1— lim e*) = e(l =0) = 6a. 
x—0o xXxOoO x—>0oO x—oo 
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Example 2.1.15 Let 
2x? -—x +1 


3x2 +2x-1° 
Trying to find lim,_,o9 g(x) by applying a version of Theorem 2.1.4 to this fraction as it is 
written leads to an indeterminate form (try it!). However, by rewriting it as 


g(x) = 


2—1/x + 1/x? 


BO) = 3 2x Mat 


x #0, 
we find that 
. _ 4 ‘ 2 
Jo eT ee Salil: 2 


lim, g(x) = 22 2 ee 
x00 lim 3+ lim 2/x— lim 1/x 3+0-0 3 
xXxOoO xO 200 
Monotonic Function 
A function f is nondecreasing on an interval J if 

F (x1) < f(x2) whenever x; and x2 are in J and x; < Xo, (2.1.19) 
or nonincreasing on I if 

F (x1) = f(x2) whenever x; and x2 are in J and x1 < xX. (2.1.20) 


In either case, f is on J. If < can be replaced by < in (2.1.19), f is increasing on I. If > 
can be replaced by > in (2.1.20), f is decreasing on I. In either of these two cases, f is 
strictly monotonic on I. 


Example 2.1.16 The function 


0<x <1, 


a 
f@)= i‘ 


», L<x <2, 


is nondecreasing on J = [0, 2] (Figure 2.1.4), and — f is nonincreasing on J = [0, 2]. 


>< 


Y 
x 
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Figure 2.1.4 


is increasing on [0, oo) (Figure 2.1.5), 


The function g(x) = x? 


Figure 2.1.5 


and h(x) = —x? is decreasing on (—oo, 00) (Figure 2.1.6). 


Figure 2.1.6 
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In the proof of the following theorem, we assume that you have formulated the definitions 
called for in Exercise 2.1.19. 


Theorem 2.1.9 Suppose that f is monotonic on (a,b) and define 
a= inf f(x) and B= sup f(x). 
a<x<b 


a<x<b 
(a) If f is nondecreasing, then f(a+) = a and f(b—) = B. 


(b) Jf f is nonincreasing, then f(a+) = B and f(b—) = a. 
(Here a+ = —o0 ifa = —co and b— = wifb =~.) 


(c) Ifa <xo <b, then f(xo+) and f(xo—) exist and are finite ; moreover, 
Ff (xo-) = fo) = f(xo+) 
if f is nondecreasing, and 
f(xo-) 2 f(%o) = f(xo+) 
if f is nonincreasing. 


Proof (a) We first show that f(a+) = a. If 
M > a, there is an xo in (a,b) such that f(xo) < M. Since f is nondecreasing, 


F(x) < M ifa < x < xo. Therefore, if a = —oo, then f(a+) = —oo. If a > —on, let 
M =a-+e, where e > 0. Thena < f(x) <a+e,so 
|[f(x)-al<e if a<x<xXo. (2.1.21) 


If a = —oo, this implies that f(—oo) = a. If a > —oo, let 6 = x9 — a. Then (2.1.21) is 
equivalent to 
|\f(x)-al<e if a<x<a+té, 
which implies that f(a+) = a. 
We now show that f(b—) = B. If M < #, there is an xo in (a, b) such that f(x9) > M. 


Since f is nondecreasing, f(x) > M if x9 < x < b. Therefore, if B = ov, then 
f(b-) = oo. If B < oo, let M = B —«, where « > 0. Then 6B —€ < f(x) < B,s0 
|[f(x)-—Bl<e if x <x <b. (2.1.22) 


If b = oo, this implies that f(co) = B. If b < ow, let 6 = b — xo. Then (2.1.22) is 
equivalent to 


|\f(x)-Bl<e if bD-85<x <b, 
which implies that f(b—) = B. 
(b) The proof is similar to the proof of (a) (Exercise 2.1.34). 
(c) Suppose that f is nondecreasing. Applying (a) to f on (a, xo) and (xo, b) sepa- 
rately shows that 


f(xo-) = sup f(x) and Ps et 


a<x<xo 
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However, if x1 < X90 < Xo, then 


f(x1) = fo) <= f(x2); 
hence, 


I (xo—) < f(xo) <= f(xot). 


We leave the case where f is nonincreasing to you (Exercise 2.1.34). 0 


Limits Inferior and Superior 


We now introduce some concepts related to limits. We leave the study of these concepts 
mainly to the exercises. 

We say that f is bounded on a set S if there is aconstant M < oo such that | f(x)| < M 
for all x in S. 


Definition 2.1.10 Suppose that f is bounded on [a, xo), where xo may be finite or oo. 
For a < x < Xo, define 


S¢(xix0) = sup f(t) 


x<t<x0 
and 
T f(x; X0) = ou f(t). 
Then the /eft limit superior of f at xo is defined to be 
im f(x) = lim _S¢(x; x0), 
and the left limit inferior of f at xo is defined to be 


lim f(x) = lim J¢(x; x0). 
x>x0- xXx>XQ—- 


(If x9 = 00, we define xpg— = od.) 


Theorem 2.1.11 /f f is bounded on [a, xo), then B = Tittincjae = Ff (x) exists and is 
the unique real number with the following properties : 


(a) Ife > 0, there is an a, in [a, xo) such that 
F(x)<Bte if ay<x <x. (2.1.23) 
(b) Ife > Oand ay is in [a, xo), then 
F(*) > B-€ forsome  X € [a1, Xo). 


Proof Since f is bounded on [a, xo), S¢(x;xo) is nonincreasing and bounded on 
[a, xo). By applying Theorem 2.1.9(b) to S (x; x0), we conclude that f exists (finite). 
Therefore, if ¢ > 0, there is an @ in [a, xo) such that 


B-—€/2<S f(xixo)<Bte/2 if @<x<xo. (2.1.24) 


48 Chapter 2 Differential Calculus of Functions of One Variable 


Since S ¢ (x; Xo) is an upper bound of {f(0) | x<t< xo}, S (x) < S¢(x; x0). Therefore, 
the second inequality in (2.1.24) implies (2.1.23) with a, = @. This proves (a). To prove 
(b), let a, be given and define x; = max(a,,d@). Then the first inequality in (2.1.24) 
implies that 

S (x1; x0) > B-—€/2. (2.1.25) 


Since S ¢(x1; Xo) is the supremum of {f(0) | xXy<t< xo}, there is an X in [x;, x9) such 
that 

F(X) > S¢ (x15 x0) — €/2. 
This and (2.1.25) imply that f(x) > B —e. Since X is in [a1, xo), this proves (b). 

Now we show that there cannot be more than one real number with properties (a) and 
(b). Suppose that B; < Bz and £2 has property (b); thus, if ¢ > 0 and ay is in [a, xo), 
there is an X in [a1, Xo) such that f(x) > Bo —e. Letting « = Bo — f1, we see that there 
is an X in [a;, b) such that 


SI (®) > Bo — (B2 — Bi) = Bi, 


so B; cannot have property (a). Therefore, there cannot be more than one real number 
that satisfies both (a) and (b). a 


The proof of the following theorem is similar to this (Exercise 2.1.35). 


Theorem 2.1.12 /f f is bounded on [a, x0), thena = lim, _,.,— f(x) exists and is 
the unique real number with the following properties: 


(a) Ife > 0, there is an ay in [a, xo) such that 


f(x)>a-e if a,<x<Xo. 


(b) Ife > Oand ay is in [a, xo), then 


f(®)<a+te forsomeX € [a, Xo). 


2.1 Exercises 


1. Each of the following conditions fails to define a function on any domain. State 


why. 
(a) sin f(x) = x (b) ef = |x| 
(c)1+x*+[f@p) =0 (d) f@)[F@) — 1] = x? 
2. If ; 
f= @=-HDE+2) and g(x) = i x2 — 9, 
x-1 eo 


find Dy, Drrte> D fg, and D f/g- 
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Find D f. 
(a) f(x) = tanx (b) f(x) = —+— 

1 —|sinx| 
(c) f@) = — (4) fe) = 


x(x — 1) 


(e) lV@F =x, f(x) 20 


Find lim,-,x, f(x), and justify your answers with an €-6 proof. 


(a) x7+2x4+1, x =1 (b) =, xo = 2 
x— 
1 
(c) aT xo = 0 (d) JX, xo =4 
xe] 


Xo = 1 


(e) (x —1)(« =) ¢ 
Prove that Definition 2.1.2 is unchanged if Eqn. (2.1.4) is replaced by 


| f(x) — L| < Ke, 


where K is any positive constant. (That is, limy_..) {(«) = L according to Defini- 
tion 2.1.2 if and only if lim,_,,,. f(x) = L according to the modified definition.) 


Use Theorem 2.1.4 and the known limits limy— x, x = x9, limy+x. c = c to find 
the indicated limits. 


x? +2x +3 1 1 
(2) ie 2x3 +1 (b) tim (5-4) 
x-1 x8 — 1 
(c) jim on Sa oe oe (d) jim im =F 


Find lim, x )— f(x) and lim,_.. + f(x), if they exist. Use e-d proofs, where ap- 
plicable, to justify your answers. 


1 1 1 
(a) THT e=0 (b) xcos—+sin—+sin—, x9 =0 
x x |x| 
il x? +x—-2 
, xXx=1 d) ———,, »=-2 
Oem) a) Vx +2 ° 


Prove: If h(x) > 0 fora < x < xo and limy_,x,— h(x) exists, then lim, .)— h(x) 
> 0. Conclude from this that if /2(x) > f(x) fora < x < Xo, then 


lim fo(x)> lim f((x) 
x—>x0- x—>xo- 


if both limits exist. 
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10. 


11. 
12. 
13. 


14. 
15. 


16. 


17. 


18. 


19. 


20. 
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(a) Prove: If limy-,., f(x) exists, there is a constant M anda p > 0 such that 
|f(x)| < M if 0 < |x — xo| < p. (We say then that f is bounded on 
{x |0 < |x —Xx0| < p}.) 

(b) State similar results with “limy,,,.” replaced by “limy—+x)—.” 

(c) State similar results with “lim,_,,,.” replaced by “limy—x9 4.” 


Suppose that limy_.x,) f(x) = L and zn isa positive integer. Prove that lim,—.,[f(x)]” = 


L" (a) by using Theorem 2.1.4 and induction; (b) directly from Definition 2.1.2. 
HINT: You will find Exercise 2.1.9 useful for (b). 


Prove: If lim, ) f(x) = L > 0, then limy+x) V f(x) = VL. 
Prove Theorem 2.1.6. 


(a) Using the hint stated after Theorem 2.1.6, prove that Theorem 2.1.3 remains 
valid with “lim,—x,” replaced by “limx—x9—.” 

(b) Repeat (a) for Theorem 2.1.4. 

Define the statement “limy.-.9 f(x) = L.” 


Find limy.0 f(x) ifit exists, and justify your answer directly from Definition 2.1.7. 


1 sin x sin x 
(a) aad (b) me (a > 0) (c) Re (a <0) 
(d) e™ sinx (e) tanx (£) e-* 62% 


Theorems 2.1.3 and 2.1.4 remain valid with “lim,-.,,” replaced throughout by 
“TiMy-00” (“lim,—— 99”). How would their proofs have to be changed? 


Using the definition you gave in Exercise 2.1.14, show that 
; I _ _2(X| 
(2) (1 7 =) =I OO) ag 


(c) lim  sinx does not exist 
x—>—-CO 


Find limy+-oo f(x), if it exists, for each function in Exercise 2.1.15. Justify your 
answers directly from the definition you gave in Exercise 2.1.14. 


Define 


(a) lim f(xv)=-co (b) lim f(xv)=co (ec) lim f(x) =-0o 
xX>x0- X—>xo+ X—>xo+ 
Find 
(a) lim, — (b) lim — 
a Pars ym x3 aa x2 
(c) i (a) lim — 
- pars x6 aca xe 
(e) lim, — (f) hi 
pores (x — xo)2* xx0- (x — x9)2k+1 


(k = positive integer) 


21. 


22. 


23. 


24. 


25. 


26. 


27. 
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Define 
(a) lim f(x) = 00 (b) lim f(x) =—oo 
xX—>x0 x>X0 
Find 
(a) lim = (b) lim = 
2 ue, x3 xb xe 
: 1 : 
(c) pe (x _ X0)2* (d) Rae (x — X0)2k+1 
(k = positive integer) 
Define 
(a) lim f(x) = 0c (b) lim f(x) = —oo 
x—-oo x—>-CO 
Find 
. 2k : 2k 
(a) ms (>) lin 
: 2k+1 : 2k+1 
(©) ms (2) tim. 
(k=positive integer) 
. : s x 
(e) Jim, Jx sinx (f) Jim e 


Suppose that f and g are defined on (a, oo) and (c, 00) respectively, and that 
g(x) > aif x > c. Suppose also that limy+o f(x) = L, where —co < L < ~, 
and lim-+99 g(x) = oo. Show that limy+o f(g(x)) = L. 


(a) Prove: limy-+x,. f(x) does not exist (finite) if for some €9 > 0, every deleted 
neighborhood of x9 contains points x; and x2 such that 


| f(x1) — F%2)| = €0- 
(b) Give analogous conditions for the nonexistence of 


lim f(x), lim f(x), Jim f(x), and lim f(x). 


x>xo+ 


Prove: If —oo < xg < oo, then limy-.x,. f(x) exists in the extended reals if and 
only if lim, +. ,— f(x) and lim,_.x)4 f(x) both exist in the extended reals and are 
equal, in which case all three are equal. 


In Exercises 2.1.28—2.1.30 consider only the case where at least one of L1 and Lz is +o. 


28. 


Prove: If limy+x9 f(x) = L1, limy+x, g(x) = Lo, and L; + Lz is not indetermi- 
nate, then 

lim (f + g)(x) = 114+ Lp. 

x>XO 
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29. 


30. 


31. 


32. 


33. 


34. 


35. 
36. 


37. 
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Prove: If limyo9 f(x) = 11, limy+oo g(x) = Lo, and L, L2 is not indeterminate, 
then 


lim (fg)(x) = LiLo. 
xX—FOO 
(a) Prove: If limy+x. f(x) = Li, limy+x9 g(x) = Lo 4 0, and L1/Lz is not 


indeterminate, then 
L 
lim (4) (x) = — 
x>x0 \ g Lo 


(b) Show that it is necessary to assume that Ly 4 0 in(a) by considering f(x) = 
sinx, g(x) = cosx, and x9 = 1/2. 


Find 

3 3 

x? + 2x +3 x? + 2x +3 

a) in —— b) lim ———~—— 

ta) lit 544992 4 ( ) lim oy pad 
2x4 + 3x2 +2 — Wxt+3x24+2 


lim ————— d ——_—____ 
cee x3 +2x +3 ( Pee x3 +2x +3 


. .  x+./xsinx 
(e) limy-soo(e* —e*) (f) nuUe a 


Find limy— oo r(x) and lim,,-+—99 r(x) for the rational function 
do + 1X +++ + ayx" 
r(x) = ————__. 
bo + Bix + +++ + bmx™ 
where an # O and by # 0. 


Suppose that limy_.x,. f(x) exists for every xo in (a,b) and g(x) = f(x) except 
on a set S with no limit points in (a, b). What can be said about limy-.x, g(x) for 
Xo in (a, b)? Justify your answer. 


Prove Theorem 2.1.9(b), and complete the proof of Theorem 2.1.9(b) in the case 
where f is nonincreasing. 


Prove Theorem 2.1.12. 


Show that if f is bounded on [a, xo), then 
(a) lim f(x) < Tm f(x). 
x>X0—- 


x>XQ- 


(b) lim (—f)(x)=— Tim f(x) and Tim (—f)(x) =— lim f(x). 


x>XO- 


(c) =. f(x) = tim f(x) if and only if limy—x)— f(x) exists, in which 
case 


im f@) = lim f(x) = fim_f(). 


x>XQ—- 


Suppose that f and g are bounded on [a, x). 
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(a) Show that 


tim _(f + g)(x) s Tim f(x) + Tim _ g(x). 


(b) Show that 


lim (f+ g)(x)>= lim f(x)+ lim g(a). 


x>xX0— x >x0- x>xX0— 
(c) State inequalities analogous to those in (a) and (b) for 


lim (f — g)(x) and im_(f — 8)@). 


x>XQ—- 


38. Prove: limy-+x,)— f(x) exists (finite) if and only if for each € > 0 there is ad > 0 
such that | f(x1) — f(x2)| < € if x9 —6 < x1, X2 < Xo. HINT: For sufficiency, 
show that f is bounded on some interval (a, Xo) and 


fim f(x) = lim fe). 


x>XQ—- 


Then use Exercise 2.1.36(c). 
39. Suppose that f is bounded on an interval (xo, b]. Using Definition 2.1.10 as a guide, 
define limy—xo+ f(x) (the right limit superior of f at xo) and lim, _,,.4 f(x) (the 
right limit inferior of f at xo). Then prove that they exist. HINT: Use Theorem 2.1.9. 
40. Suppose that f is bounded on an interval (xo, b]. Show that lim, ,..4 f(x) = 
Timy+x9+ f(x) if and only if lim,..)+ f(x) exists, in which case 


lim (0) = tim fe) = Tim, fo, 


x>X0 x—>x0 


41. Suppose that f is bounded on an open interval containing x9. Show that lim,-... f(x) 
exists if and only if 


lim f(x) = lim f(x) = lim f(x) = lim f(x), 
x>x0- xX>x0+ x>x0—- x>x0+ 


in which case limy-+x, f(x) is the common value of these four expressions. 


2.2 CONTINUITY 


In this section we study continuous functions of a real variable. We will prove some impor- 
tant theorems about continuous functions that, although intuitively plausible, are beyond 
the scope of the elementary calculus course. They are accessible now because of our better 
understanding of the real number system, especially of those properties that stem from the 
completeness axiom. 
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The definitions of 
f(xo-) = lim f(x), f(xot) = lim f(x), and lim f(x) 
x>xo0- x—>xo+ x—>x0 


do not involve f (xo) or even require that it be defined. However, the case where f (xo) is 
defined and equal to one or more of these quantities is important. 


Definition 2.2.1 


(a) Wesay that f is continuous at xo if f is defined on an open interval (a, b) containing 
Xo and limy+x) f(x) = f (Xo). 

(b) We say that f is continuous from the left at xo if f is defined on an open interval 
(a, xo) and f(xo—) = f (xo). 

(c) We say that f is continuous from the right at xo if f is defined on an open interval 
(xo, 5) and f(xo+) = f (xo). a 


The following theorem provides a method for determining whether these definitions are 
satisfied. The proof, which we leave to you (Exercise 2.2.1), rests on Definitions 2.1.2, 
2.1.5, and 2.2.1. 


Theorem 2.2.2 


(a) A function f is continuous at Xo if and only if f is defined on an open interval (a, b) 
containing Xo and for each € > 0 there isa é > 0 such that 


lf Q)= f(x) << (2.2.1) 


whenever |x — Xo| <6. 


(b) A function f is continuous from the right at xo if and only if f is defined on an 
interval [xo, b) and for each € > 0 there is a5 > 0 such that (2.2.1) holds whenever 
xo <xX <x +6. 


(c) A function f is continuous from the left at xo if and only if f is defined on an interval 
(a, Xo] and for each « > 0 


there is ad > 0 such that (2.2.1) holds whenever x9 — 6 < x < Xo. 


From Definition 2.2.1 and Theorem 2.2.2, f is 


continuous at Xo if and only if 
f(x0-) = f(xo+) = f(%o) 
or, equivalently, if and only if it is continuous from the right and left at x9 (Exercise 2.2.2). 
Example 2.2.1 Let f be defined on [0, 2] by 


x7, 0<x <1, 


a en a 
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(Figure 2.2.1); then 


f0+)=0= f(0), 
fU-)=14 fd) =2, 
f0+)=2= FQ), 
fQ-)=3 = fQ). 


Therefore, f is continuous from the right at 0 and 1 and continuous from the left at 2, but 
not at 1. IfO < x, x9 < 1, then 


| f(x) — f(%o)| = |x? — x9] = |x — xol |x + xo 
<2|x-—xol<e if |x—Xxo| <€/2. 


Hence, f is continuous at each xo in (0, 1). If 1 < x, x9 < 2, then 


If (x) — f(xo)| = |e + 1) — (xo + 1) = |x — xo] 


<e if |x—xo| <e. 


Hence, f is continous at each Xo in (1, 2). 


Figure 2.2.1 


Definition 2.2.3 A function f is continuous on an open interval (a, b) if it is continu- 
ous at every point in (a, b). If, in addition, 


fb-) = f(b) (2.2.2) 
or 


fat) = fa) (2.2.3) 
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then f is continuous on (a, b] or [a,b), respectively. If f is continuous on (a,b) and 
(2.2.2) and (2.2.3) both hold, then f is continuous on [a, b]. More generally, if S is a subset 
of D ¢ consisting of finitely or infinitely many disjoint intervals, then f is continuous on S 
if f is continuous on every interval in S. (Henceforth, in connection with functions of one 
variable, whenever we say “f is continuous on S” we mean that S is a set of this kind.) 


Example 2.2.2 Let f(x) = /x,0 <x < oo. Then 
lf@) -—fO|=JSx<e if O<x<e?’, 
so f(0O+) = f(0). If xo > O and x > 0, then 


If) — feo)| = IE — Fa] = Fre 


x—Xx 
| er if |x —xo| < €./Xo, 


Jxo 


so limy+x9 f(x) = f (xo). Hence, f is continuous on [0, oo). 


as 


Example 2.2.3 The function 


is continuous on S = S aaueee (77 n + 1). However, g is not continuous at any x9 = n 


(integer), since it is not defined at such points. | 


The function f defined in Example 2.2.1 (see also Figure 2.2.1) is continuous on [0, 1) 
and [1, 2], but not on any open interval containing |. The discontinuity of f there is of the 
simplest kind, described in the following definition. 


Definition 2.2.4 A function f is piecewise continuous on [a, b] if 

(a) f(xo+) exists for all xo in [a, b); 

(b) f(xo—) exists for all xo in (a, 5]; 

(c) f(xo+) = f(xo—) = f (xo) for all but finitely many points xo in (a, d). 

If (c) fails to hold at some xo in (a,b), f has a jump discontinuity at xo. Also, f has a 
jump discontinuity at a if f(a+) # f(a) orat bif f(b—-) # f(b). 


Example 2.2.4 The function 


1, x=0, 
x, O<x<l, 

2, x=, 
f@)= x, 1<x <2, 
-l, 2<x <3, 

0, x =3, 


(Figure 2.2.2) is the graph of a piecewise continuous function on [0, 3], with jump discon- 
tinuities at x9 = 0, 1, 2, and 3. 
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>< 


Figure 2.2.2 


The reason for the adjective “jump” can be seen in Figures 2.2.1 and 2.2.2, where the 
graphs exhibit a definite jump at each point of discontinuity. The next example shows that 
not all discontinuities are of this kind. 


Example 2.2.5 The function 


f(x) = * 
0, x =0, 


is continuous at all x9 except x9 = 0. As x approaches 0 from either side, f(x) oscillates 
between —1 and 1 with ever-increasing frequency, so neither f(0+) nor f(O—) exists. 
Therefore, the discontinuity of f at 0 is not a jump discontinuity, and if p > 0, then f is 
not piecewise continuous on any interval of the form [—p, 0], [—p, p], or [0, p]. a 


Theorems 2.1.4 and 2.2.2 imply the next theorem (Exercise 2.2.18). 


Theorem 2.2.5 /f f and g are continuous ona set S, then so are f + g, f — g, and 
fg. In addition, f /g is continuous at each Xo in S such that g(xo) # 0. 


Example 2.2.6 Since the constant functions and the function f(x) = x are continu- 
ous for all x, successive applications of the various parts of Theorem 2.2.5 imply that the 
function 

9 — x? 


r(x) = ai 
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is continuous for all x except x = —1 (see Example 2.1.7). More generally, by starting 
from Theorem 2.2.5 and using 


induction, it can be shown that if fi, fo, ..., fn are continuous on a set S, then so are 
Ait fot---+ fy and fi fo--- fy. Therefore, any rational function 
Ago +ayx +++++dyx" 


a= bo +bhyx +-++ + dyx™ 


(bm # 0) 


is continuous for all values of x except those for which its denominator vanishes. 


Removable Discontinuities 


Let f be defined on a deleted neighborhood of xo and discontinuous (perhaps even unde- 
fined) at xo. We say that f has a at x9 if limy_.x,) f(x) exists. In this case, the function 
F(x) ifx ¢ Dr andx F xo, 
gX) = lim f(x) ifx = x0, 
x>X0 


is continuous at Xo. 


Example 2.2.7 The function 


f(x) = ei 
x 


is not defined at xo = 0, and therefore certainly not continuous there, but limy9 f(x) = 0 
(Example 2.1.6). Therefore, f has a removable discontinuity at 0. 


The function i 
fila) = sin = 
x 


is undefined at 0 and its discontinuity there is not removable, since lim,—.9 fi (x) does not 
exist (Example 2.2.5). 


Composite Functions 


We have seen that the investigation of limits and continuity can be simplified by regarding a 
given function as the result of addition, subtraction, multiplication, and division of simpler 
functions. Another operation useful in this connection is composition of functions; that is, 
substitution of one function into another. 


Definition 2.2.6 Suppose that f and g are functions with domains Dy and Dg. If 
Dg has a nonempty subset T such that g(x) € Dy whenever x € T, then the composite 
function f o g is defined on T by 


(f 0 g(x) = f(g(x)). 
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Example 2.2.8 If 


1 
f(x) =logx and g(x) = ——,, 
1— x? 


then 
Dy =(0,00) and Dg = {x|x #41}. 


Since g(x) > Oif x € T = (—1, 1), the composite function f o g is defined on (—1, 1) by 


(f ©.g)(x) = log —,. 
—x 
We leave it to you to verify that g o f is defined on (0, 1/e) U (1/e, e) U (e, 0) by 
1 
° x) = ———>. a 
6° NO =a 
The next theorem says that the composition of continuous functions is continuous. 


Theorem 2.2.7 Suppose that g is continuous at xo, g(Xo) is an interior point of D f, 
and f is continuous at g(xo). Then f 0 g is continuous at Xo. 


Proof Suppose that « > 0. Since g(xo) is an interior point of D ¢ and f is continuous 
at g(x), there is a 5; > 0 such that f(t) is defined and 


If — f(g@o))l<e if |t—g(xo)| < 41. (2.2.4) 
Since g is continuous at x9, there is a6 > 0 such that g(x) is defined and 
lg(x) — g(xo)| < 61 if |x—xo| <6. (2.25) 


Now (2.2.4) and (2.2.5) imply that 
f(g) — f(g@o))| <€ if |x—xo| <8. 


Therefore, f o g is continuous at Xo. 0 


See Exercise 2.2.22 for a related result concerning limits. 


Example 2.2.9 In Examples 2.2.2 and 2.2.6 we saw that the function 
f(x) = Vx 
is continuous for x > 0, and the function 
9 — x? 
x+1 


is continuous for x # —1. Since g(x) > Oif x < —3 or —-1 < x < 3, Theorem 2.2.7 
implies that the function 


a(x) = 


2 


(f © g)(x) = ae 


is continuous on (—oo, —3) U (1, 3). It is also continuous from the left at —3 and 3. 
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Bounded Functions 
A function f is bounded below ona set S if there is a real number m such that 
F(x) =m forallx € S. 


In this case, the set 
V= {f(x)|x €¢ S} 
has an infimum q@, and we write 
a = inf f(x). 
xeS 


If there is a point x; in S such that f(x) = a, we say that @ is the minimum of f on S, 
and write 


a= se F(x). 


Similarly, f is bounded above on S if there is a real number M such that f(x) < M for 
all x in S. In this case, V has a supremum £, and we write 


B = sup f(x). 
xeS 


If there is a point x2 in S such that f(x2) = B, we say that 6 is the maximum of f on S, 
and write 


B= max fm). 


If f is bounded above and below on a set S, we say that f is bounded on S. 


Figure 2.2.3 illustrates the geometric meaning of these definitions for a function f 
bounded on an interval S = [a,b]. The graph of f lies in the strip bounded by the 
lines y = M and y = m, where M is any upper bound and m is any lower bound 
for f on [a,b]. The narrowest strip containing the graph is the one bounded above by 
y = =supyey<y f(x) and below by y =a = infyerep f(x). 


y 
A 


Figure 2.2.3 
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Example 2.2.10 The function 


as 5, x=0 or x=1, 
g(x) = + 
l—-x, 0<x<l, 


(Figure 2.2.4(a)) is bounded on [0, 1], and 


sup g(x) = 1, inf g(x) =0. 
0<x<1 


0<x<1 
Therefore, g has no maximum or minimum on [0, 1], since it does not assume either of the 
values 0 and 1. 
The function 
h(x) =1-x, O<x <1, 
which differs from g only at 0 and 1 (Figure 2.2.4(b)), has the same supremum and infi- 


mum as g, but it attains these values at x = 0 and x = 1, respectively; therefore, 


omax, hx) =1 and oa h(x) = 0. 


Figure 2.2.4 


Example 2.2.11 The function 


1 
fia ee) gn ——— 0 ee 1 


x(x — 1) 


oscillates between +e*— infinitely often in every interval of the form (0, p) or (1—p, 1), 
where 0 < p < 1, and 


sup f(x) = 1, pint, fO) = 1. 


0<x<l1 


However, f does not assume these values, so f has no maximum or minimum on (0, 1). 
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Theorem 2.2.8 /f f is continuous on a finite closed interval [a,b], then f is bounded 
on [a, b]. 


Proof Suppose that ¢ € [a,b]. Since f is continuous at f, there is an open interval J; 
containing ¢ such that 


If) —f@l| <1 if xe, N[a,d]. (2.2.6) 


(To see this, set € = 1 in (2.2.1), Theorem 2.2.2.) The collection # = {I; |a <t <b} is 
an open covering of [a,b]. Since [a,b] is compact, the Heine—Borel theorem implies that 
there are finitely many points f1, f2, ..., f, such that the intervals [;,, [j,,..., [1, cover 
[a, b]. According to (2.2.6) with t = ¢;, 


lf) —-f@)| <1 if x eh, A[a,b). 
Therefore, 


IFC) = IF) — FG) + F@I Ss 1FC) -— F@+1F@!| 


(2.2.7) 
<1+/f(@)| if x eh, 0[a,d]. 
Let 
M = 1+ max |f()|. 
Since [a,b] C Uy (Ir; 9 [a, b]), (2.2.7) implies that | f(x)| < M if x € [a,b]. q 


This proof illustrates the utility of the Heine—Borel theorem, which allows us to choose 
M as the largest of a finite set of numbers. 


Theorem 2.2.8 and the completeness of the reals imply that 


if f is continuous on a finite closed interval [a,b], then f has an infimum and a supre- 
mum on [a,b]. The next theorem shows that f actually assumes these values at some 
points in [a, b]. 


Theorem 2.2.9 Suppose that f is continuous on a finite closed interval |a, b]. Let 


a= nf FO) and B= sup f(x). 


aSXxs a<x<b 


Then a and B are respectively the minimum and maximum of f on [a, b); that is, there are 
points x1 and x2 in [a, b] such that 


fi) =a and f(x2) =. 


Proof We show that x; exists and leave it to you to show that x2 exists (Exercise 2.2.24). 


Suppose that there is no x; in [a,b] such that f(x1) = a. Then f(x) > o@ for all 
x € [a, b]. We will show that this leads to a contradiction. 


Suppose that ¢ € [a,b]. Then f(t) > a, so 


p> LOF* sg 
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Since f is continuous at ¢, there is an open interval J; about ¢ such that 


f(t) +a 
2 


f(x) > if xeI,n{a,d] (2.2.8) 


(Exercise 2.2.15). The collection Jf = {I | a<t< b} is an open covering of [a, b]. Since 
[a, b] is compact, the Heine—Borel theorem implies that there are finitely many points fy, 


to, ..., ¢, such that the intervals /;,, [,,,..., It, cover [a, b]. Define 
_ f(ti)t+a 
a, = min 
1<i<n 2 


Then, since [a,b] C U1 Ut, 9 [a, b]), (2.2.8) implies that 
ft) >a, ax<t<b. 


But a > q, so this contradicts the definition of w. Therefore, f(x) = @ for some x, in 


[a, b]. O 
Example 2.2.12 We used the compactness of [a,b] in the proof of Theorem 2.2.9 


when we invoked the Heine—Borel theorem. To see that compactness is essential to the 
proof, consider the function 


g(x) =1-(A eae: 
x 


which is continuous and has supremum 2 on the noncompact interval (0, 1], but does not 
assume its supremum on (0, 1], since 


g(x) =1+0-%) 


ol 
sin — 
x 


<1+(d-x)<2 if O<x<l. 
As another example, consider the function 
f(x) =e™, 


which is continuous and has infimum 0, which it does not attain, on the noncompact interval 
(0, 00). | 


The next theorem shows that if f is continuous on a finite closed interval [a, b], then f 
assumes every value between f(a) and f(b) as x varies from a to b (Figure 2.2.5, page 64). 


Theorem 2.2.10 (Intermediate Value Theorem) Suppose that f is con- 
tinuous on [a,b], f(a) # f(b), and yu is between f(a) and f(b). Then f(c) = yu for 
some c in (a,b). 
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y=f() 


Figure 2.2.5 


Proof Suppose that f(a) < yu < f(b). The set 
S={x|a<x<b and f(x) <p} 


is bounded and nonempty. Let c = sup S. We will show that f(c) = w. If f(c) > pw, 
then c > a and, since f is continuous at c, there is an € > O such that f(x) > wif 
c—€ < x <c (Exercise 2.2.15). Therefore, c — € is an upper bound for S, which 
contradicts the definition of c as the supremum of S. If f(c) < yu, then c < b and there is 
ane > Osuch that f(x) < yu force < x <c +€, soc is not an upper bound for S. This is 
also a contradiction. Therefore, f(c) = w. 


The proof for the case where f(b) < uw < f(a) can be obtained by applying this result 
to—f. q 


Uniform Continuity 


Theorem 2.2.2 and Definition 2.2.3 imply that a 


function f is continuous on a subset S of its domain if for each ¢ > 0 and each xo in S, 
there is a 6 > 0, which may depend upon Xo as well as €, such that 


| f(x) — f(xo)| <€ if |x-—xo] <5 and xeD,. 
The next definition introduces another kind of continuity on a set S. 


Definition 2.2.11 A function f is uniformly continuous on a subset S of its domain 
if, for every « > 0, there is ad > O such that 


| f(x) — f(x’)| < € whenever |x — x’| < Sand x,x’€S. | 


We emphasize that in this definition 6 depends only on ¢ and S and not on the particular 
choice of x and x’, provided that they are bothin S. 


Example 2.2.13 The function 
f(x) = 2x 
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is uniformly continuous on (—oo, oo), since 
| f(x) — f(x’)| = 2|x-—x'|<e if [x—x'| < €/2. 


Example 2.2.14 If 0 <r < oo, then the function 


Baya 


is uniformly continuous on [—r, r]. To see this, note that 
lex) — g(x’) = |x? — P| = |x — 2" | [x + x! S Orla — x’, 
so 


le(x) —g(x’)| <e€ if x2 <8 = and —r <x,x' <r. | 


Often a concept is clarified by considering its negation: a function f is not uniformly 
continuous on S if there is an €9 > 0 such that if 5 is any positive number, there are points 
x and x’ in S such that 


Ix—x'| <6 but |f(x)— f@’)| = 0. 


Example 2.2.15 The function g(x) = x? is uniformly continuous on [—r, r] for any 


finite r (Example 2.2.14), but not on (—co, 00). To see this, we will show that if 5 > 0 
there are real numbers x and x’ such that 


|x—x'| = 8/2 and |g(x) — g(x’) 2 1. 
To this end, we write 
[gx) — g(x’) = |x? -Q'P | = [x — x'] [x +2". 
If |x — x’| = 6/2 and x, x’ > 1/6, then 
~. Ofl.. I 
Jn—x |x +x] > 5 =-=+-)]=1. 
Example 2.2.16 The function 


F(x) = cos Z 
x 


is continuous on (0, 1] (Exercise 2.2.23(i)). However, f is not uniformly continuous on 


(0, 1], since 
1 1 
IY (Ge) (wane) =? eal " 


Examples 2.2.15 and 2.2.16 show that a function may be continuous but not uniformly 
continuous on an interval. The next theorem shows that this cannot happen if the interval 
is closed and bounded, and therefore compact. 
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Theorem 2.2.12 If f is continuous on a closed and bounded interval [a,b], then f 
is uniformly continuous on [a, b]. 


Proof Suppose that « > 0. Since f is continuous on [a, b], for each ¢ in [a, b] there is 
a positive number 6; such that 


f(x) — Ff) < 5 if |x—t|<28, and x € [a,b]. (2.2.9) 
If J; = (t —6;,t + 6;), the collection 
H =I, |t €[a,b]} 


is an open covering of [a, b]. Since [a, b] is compact, the Heine—Borel theorem implies that 


there are finitely many points f, f2, ..., t, in [a, b] such that J;,, [,,..., 1, cover [a, 5]. 
Now define 
6 = min{d;, > Sty, oes oy Stn }. (2.2.10) 
We will show that if 
Ix —x’| <6 and x,x'€ [a,d], (2.2.11) 


then | f(x) — f(x’)| <e. 


From the triangle inequality, 


If) — O91 =F) ~ fe) + FG) — FO) | oe 
<= |f@)-—fG)| + |fG) — FOI. 
Since J;,, [t,,..., 1, cover [a, b], x must be in one of these intervals. Suppose that x € J;,; 
re pone.) (2.2.13) 
From (2.2.9) with t = f,, 
Lf (x) — f(t, < = (2.2.14) 


From (2.2.11), (2.2.13), and the triangle inquality, 
|x’ — ty| = |x’ — x) + (x -1#,)| < |x’ — x] + |x -t-| <8 4 5; < 26;,. 


Therefore, (2.2.9) with t = t, and x replaced by x’ implies that 
€ 
If@)- P| < 5. 


This, (2.2.12), and (2.2.14) imply that | f(x) — f(x’)| <e. q 


This proof again shows the utility of the Heine—Borel theorem, which allowed us to 
define 6 in (2.2.10) as the smallest of a finite set of positive numbers, so that 6 is sure to be 
positive. (An infinite set of positive numbers may fail to have a smallest positive member; 
for example, consider the open interval (0, 1).) 


Corollary 2.2.13 If f is continuous on a set T, then f is uniformly continuous on 
any finite closed interval contained in T. 
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Applied to Example 2.2.16, Corollary 2.2.13 implies that the function g(x) = cos 1/x 
is uniformly continuous on [p, 1] if0 < p < 1. 


More About Monotonic Functions 


Theorem 2.1.9 implies that if f is monotonic on an interval /, then f is either continuous 
or has a jump discontinuity at each x9 in 7. This and Theorem 2.2.10 provide the key to 
the proof of the following theorem. 


Theorem 2.2.14 If f is monotonic and nonconstant on [a,b], then f is continuous on 
[a, b] ifand only if its range Rf = { f(x) | x € [a, bj} is the closed interval with endpoints 
f@ and f(b). 


Proof We assume that f is nondecreasing, and leave the case > where f is nonincreasing 
to you (Exercise 2.2.34). Theorem 2.1.9(a) implies that the set R ¢ = { f(x) | x € (a, b)} 
is a subset of the open interval (f(a+), f(b—)). Therefore, 


Rp ={f@}URe ULF} CLF@}U (f+), fO-) UEF(H)}. (2.2.15) 


Now suppose that f is continuous on [a,b]. Then f(a) = f(a+), f(b—) = f(b), so 
(2.2.15) implies that Ry C [f(a), f(d)]. If f(@) < ww < f(b), then Theorem 2.2.10 
implies that 4 = f(x) for some x in (a,b). Hence, R¢ = [f(a), f(b)]. 

For the converse, suppose that R¢ = [f(a), f(b)]. Since f(a) < f(a+) and f(b—) < 
f(b), (2.2.15) implies that f(a) = f(a+) and f(b—) = f(b). We know from Theo- 
rem 2.1.9(c) that if f is nondecreasing and a < xo <b, then 


I (xo—) < f(xo) < f(xot). 


If either of these inequalities is strict, Ry cannot be an interval. Since this contradicts 
our assumption, f(xo—) = f(xo) = f(xot+). Therefore, f is continuous at x9 (Exer- 
cise 2.2.2). We can now conclude that f is continuous on [a, d]. q 


Theorem 2.2.14 implies the following theorem. 


Theorem 2.2.15 Suppose that f is increasing and continuous on [a,b], and let f(a) = 
cand f(b) = d. Then there is a unique function g defined on [c,d] such that 


s(f@)) =x, a5x<b, (2.2.16) 
and 

f(gy)) =y, cex<yK<d. (2.2.17) 
Moreover, g is continuous and increasing on [c, d]. 
Proof We first show that there is a function g satisfying (2.2.16) and (2.2.17). Since f 


is continuous, Theorem 2.2.14 implies that for each yo in [c, d] there is an Xo in [a, b] such 
that 


I (x0) = Yo, (2.2.18) 
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and, since f is increasing, there is only one such x9. Define 


&(Vo) = Xo. (2.2.19) 


The definition of xo is illustrated in Figure 2.2.6: with [c, d] drawn on the y-axis, find the 
intersection of the line y = yo with the curve y = f(x) and drop a vertical from the 
intersection to the x-axis to find xo. 


y=f@) 


Figure 2.2.6 


Substituting (2.2.19) into (2.2.18) yields 


F(g(vo)) = Yo, 
and substituting (2.2.18) into (2.2.19) yields 


&(f(X0)) = Xo. 
Dropping the subscripts in these two equations yields (2.2.16) and (2.2.17). 
The uniqueness of g follows from our assumption that f is increasing, and therefore 
only one value of x9 can satisfy (2.2.18) for each yo. 


To see that g is increasing, suppose that y, < y2 and let x; and x2 be the points in [a, b] 
such that f(x,) = y; and f(x2) = y2. Since f is increasing, x; < x2. Therefore, 


g(y1) = X1 < x2 = g(y2), 


so g is increasing. Since Rg = {g(y) | y Ee, d]} is the interval [g(c), g(d)] = [a,b], 
Theorem 2.2.14 with f and [a, b] replaced by g and [c, d] implies that g is continuous on 
[c,d]. 0 

The function g of Theorem 2.2.15 is the inverse of f, denoted by f~!. Since (2.2.16) 


and (2.2.17) are symmetric in f and g, we can also regard f as the inverse of g, and denote 


itby gl. 
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Example 2.2.17 If 


f(x) =x?, 0<x<R, 


f tO) =s0)=VJ¥, O<y<R?. 


Example 2.2.18 If 


f(x) =2x+4, O<x <2, 
7 4 
f 1) = 80) =, 4<y<8. 


2.2 Exercises 


Prove Theorem 2.2.2. 


Prove that a function f is continuous at xo if and only if 


lim f(x) = lim | (2) = f(0). 


Determine whether f is continuous or discontinuous from the right or left at xo. 
i= eGo 0 iia we Goel) 
(c) f~)=— (x =0) (d) f(x) =x? (xo arbitrary) 


XxX 
(e) fay = {TN 270 Go=0) 
(2) fey = {gn 270 Go=0 
x+ |xj|d+x). 1 
(g) fy =4 SE FO xy = 0) 
1, x=0 


Let f be defined on [0, 2] by 


f(x) = 


x+1, 1l<x<2. 


On which of the following intervals is f continuous according to Definition 2.2.3: 
[0, 1), (0, 1), (0, 1], [0, 1], [1, 2), (1, 2), (1, 2], [1, 2]? 


Let 
JE 
x-1 
On which of the following intervals is g continuous according to Definition 2.2.3: 
[0, 1), (0, 1), (0, 1], [1, 00), (1, 00)? 


g(x) = 
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10. 


11. 


12. 


13. 


14. 


15. 
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Let 
-1 if x is irrational, 


f@)= 


1 if x is rational. 
Show that f is not continuous anywhere. 
Let f(x) = 0 if x is irrational and f(p/q) = 1/q if p and gq are positive inte- 
gers with no common factors. Show that f is discontinuous at every rational and 
continuous at every irrational on (0, co). 
Prove: If f assumes only finitely many values, then f is continuous at a point xo in 
Dé‘. if and only if f is constant on some interval (x9 — 6, xo + 4). 


The characteristic function wr of a set T is defined by 


(x) 1, xeET, 
T(x) = 
. 0, x ¢T. 


Show that wr is continuous at a point x9 if and only if x9 € T° U(T°)°. 

Prove: If f and g are continuous on (a, b) and f(x) = g(x) for every x in a dense 

subset (Definition 1.1.5) of (a,b), then f(x) = g(x) for all x in (a, b). 

Prove that the function g(x) = log x is continuous on (0, 00). Take the following 

properties as given. 

(a) ditips 4 Oi) = 0, 

(b) g(x1) + g(v2) = g (x12) if x1, x2 > 0. 

Prove that the function f(x) = e** is continuous on (—oo, oo). Take the following 

properties as given. 

(a) limyo f(x) = 1. 

(b) f(x1 + x2) = f(x) f (x2), —00 < x1, x2 < ov. 

(a) Prove that the functions sinh x and cosh x are continuous for all x. 

(b) For what values of x are tanh x and coth x continuous? 

Prove that the functions s(x) = sin x and c(x) = cos x are continuous on (—o0, 00). 

Take the following properties as given. 

(a) limy.9 c(x) = 1. 

(b) c(x1 — x2) = c(x1)e(x2) + 8(x1)5(X2), 00 < X1,X2 < 00. 

(c) s2(x)+c?(x)=1, -0o <x <0o. 

(a) Prove: If f is continuous at xo and f(xo) > p, then f(x) > p for all x in 
some neighborhood of xo. 

(b) State a result analogous to (a) for the case where f(x0) < LU. 

(c) Prove: If f(x) < pu forall x in S and xo is a limit point of S at which f is 
continuous, then f(x9) < jp. 

(d) State results analogous to (a), (b), and (c) for the case where f is contin- 
uous from the right or left at x9. 


16. 


17. 


18. 
19. 


20. 


21. 


22. 


23. 


24. 
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Let | f| be the function whose value at each x in Dy is | f(x)|. Prove: If f is 
continuous at Xo, then so is | f|. Is the converse true? 


Prove: If f is monotonic on [a, b], then f is piecewise continuous on [a, b] if and 
only if f has only finitely many discontinuities in [a, ]. 


Prove Theorem 2.2.5. 
(a) Show that if fi, fo, ..., fn are continuous ona set S then so are fi + fo + 


re Sh and fi fo--+ fn: 
(b) Use (a) to show that a rational function is continuous for all values of x 
except the zeros of its denominator. 


(a) Let fi and fp be continuous at xo and define 


F(x) = max (fi(x), fax). 


Show that F' is continuous at xo. 
(b) Let fi, fo,..., fn be continuous at xo and define 


F(x) = max (fi(x), f2(x),..-. fn(x)). 


Show that F’ is continuous at Xo. 
Find the domains of f o g and go f. 
(a) f@)= VE. g(x) =1-x? — (b) f(x) = logx, g(x) =sinx 
1 : 
(c) f(x) = Tox?’ g(x) =cosx (d) f(x) = Vx, g(x) = sin2x 
a) Suppose that yop = lim,-,,, g(x) exists and is an interior point of D+, and 
Pp y of Pp ie 
that f is continuous at yo. Show that 


lim (F © g)(x) = f (yo). 


(b) State an analogous result for limits from the right. 
(c) State an analogous result for limits from the left. 


Use Theorem 2.2.7 to find all points x9 at which the following functions are contin- 
uous. 


(a) V1 — x? (b) sine” (c) log(1 + sin x) 


1 . 1 
G12 (f) sin (—) 


(g) (1 —sin? x)~1/? (h) cot(1 — e~*”) (i) cos . 


(d) e7V/G-2x) (e) sin 


Complete the proof of Theorem 2.2.9 by showing that there is an x2 such that 


S(x2) = B. 
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25. 


26. 


27. 


28. 


29. 


30. 


31. 


32. 


33. 


Chapter 2 Differential Calculus of Functions of One Variable 


Prove: If f is nonconstant and continuous on an interval J, then the set S = 
{ y | y= f(x),xel is an interval. Moreover, if J is a finite closed interval, then 
sois S. 


Suppose that f and g are defined on (—oo, 00), f is increasing, and f o g is con- 
tinuous on (—oo, oo). Show that g is continuous on (—oo, co). 


Let f be continuous on [a, b), and define 


F(x) = max f(t), a<x<b. 


(How do we know that F is well defined?) Show that F is continuous on [a, b). 
Let f and g be uniformly continuous on an interval S. 


(a) Show that f + g and f — g are uniformly continuous on S. 
(b) Show that fg is uniformly continuous on S if S is compact. 


Cc Show that is uniformly continuous on S if S is compact and has no 
zeros in S. 


(d) Give examples showing that the conclusion of (b) and (c) may fail to hold 
if S is not compact. 

(e) State additional conditions on f and g which guarantee that fg is uniformly 
continuous on S even if S is not compact. Do the same for f/g. 


Suppose that f is uniformly continuous on a set S, g is uniformly continuous on a 
set T, and g(x) € S for every x in T. Show that f o g is uniformly continuous on 
T. 


(a) Prove: If f is uniformly continuous on disjoint closed intervals 11, Jo, . 
I,, then f is uniformly continuous on Ca Tj. 

(b) Is (a) valid without the word “closed”? 

(a) Prove: If f is uniformly continuous on a bounded open interval (a, b), then 
F (a+) and f(b—) exist and are finite. HINT: See Exercise 2.1.38. 

(b) Show that the conclusion in (a) does not follow if (a, b) is unbounded. 
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Prove: If f is continuous on [a, oo) and f (co) exists (finite), then f is uniformly 
continuous on [a, 00). 


Suppose that f is defined on (—oo, oo) and has the following properties. 
(i) lim f(x) =1 and (ii) f(ritx2) = f(x1) f (x2), —-00 < x1, x2 < 00. 
x= 


Prove: 


(a) f(x) > 0 forall x. 
(b) f(rx) = [f()]’ if r is rational. 
(c) If f(1) = 1 then f is constant. 
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(d) If f(1) = p > 1, then / is increasing, 
lim f(x) = oo, and lim f(x) =0. 
x00 x—>-oCOo 


(Thus, f(x) = e®* has these properties if a > 0.) 
HINT: See Exercises 2.2.10 and 2.2.12. 


34. Prove Theorem 2.2.14 in the case where f is nonincreasing. 


2.3 DIFFERENTIABLE FUNCTIONS OF ONE VARIABLE 


In calculus you studied differentiation, emphasizing rules for calculating derivatives. Here 
we consider the theoretical properties of differentiable functions. In doing this, we assume 
that you know how to differentiate elementary functions such as x”, e*, and sin x, and we 
will use such functions in examples. 


Definition of the Derivative 


Definition 2.3.1 A function f is differentiable at an interior point xo of its domain if 
the difference quotient 
f(x) — fo) 


X — Xo 


x #Xo, 


approaches a limit as x approaches xo, in which case the limit is called the derivative of f 
at Xo, and is denoted by f’(xo); thus, 


Sf’ (x0) = lim I (x) = F (Xo) (23.1) 
X>X0 x—Xo 
It is sometimes convenient to let x = x9 + / and write (2.3.1) as 
. xo th)— f(x 
Sf’ (x0) — a —_ = Hi 


If f is defined on an open set S, we say that f is differentiable on S if f is differentiable 
at every point of S. If f is differentiable on S, then f’ is a function on S. We say that 
f is continuously differentiable on S if f' is continuous on S. If f is differentiable on a 
neighborhood of x9, it is reasonable to ask if f’ is differentiable at xo. If so, we denote the 
derivative of f’ at xo by f”(xo). This is the second derivative of f at xo, and it is also 
denoted by f (xo). Continuing inductively, if f~) is defined on a neighborhood of 
Xo, then the nth derivative of f at xo, denoted by f (xo), is the derivative of f“~" at 
Xo. For convenience we define the zeroth derivative of f to be f itself; thus 


fO =f 


We assume that you are familiar with the other standard notations for derivatives; for 
example, 


ff? a a Go a f", 
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and so on, and 
d" f 
dx” 


= fo, 


Example 2.3.1 If is a positive integer and 


f(x) = x", 
then 
n-1 
f(x)— f(%0) — x" -— x9 | X—X0 nko yk 
——= oo 0° 
x XO x XO %& XO k=0 
so 
n—-1 
! . n—k-1,k n—-1 
xo) = lim x Xo =MNXxo. 
Fo) = Jim ye 0 0 
k=0 
Since this holds for every xo, we drop the subscript and write 
d 
“x) =nx™ of = —(x") = nx", | 
f'@) = 


To derive differentiation formulas for elementary functions such as sin x, cos x, and e*~ 
directly from Definition 2.3.1 requires estimates based on the properties of these functions. 
Since this is done in calculus, we will not repeat it here. 


Interpretations of the Derivative 


If f(x) is the position of a particle at time x # Xo, the difference quotient 


f(x) — fo) 


X — Xo 


is the average velocity of the particle between times x9 and x. As x approaches xo, the 
average applies to shorter and shorter intervals. Therefore, it makes sense to regard the limit 
(2.3.1), if it exists, as the particle’s instantaneous velocity at time x9. This interpretation 
may be useful even if x is not time, so we often regard f’(xo) as the instantaneous rate of 
change of f (x) at Xo, regardless of the specific nature of the variable x. The derivative also 
has a geometric interpretation. The equation of the line through two points (x9, f(xo)) and 
(x1, f(x1)) on the curve y = f(x) (Figure 2.3.1) is 


p= fee aT es: 
X1 —Xo 


Varying x; generates lines through (xo, f(xo)) that rotate into the line 


y = f(xo) + f'(x0)(x — x0) (2.3.2) 
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as X; approaches x9. This is the tangent to the curve y = f(x) at the point (xo, f(Xo)). 
Figure 2.3.2 depicts the situation for various values of x1. 


y 
A 


y=f) 


Figure 2.3.1 


Figure 2.3.2 


Here is a less intuitive definition of the tangent line: If the function 
T(x) = f(xo) + m(x — x0) 


approximates f so well near xo that 


, FHT) 
in —— = 


X—>X0 x—Xo0 


0, 


we say that the line y = T(x) is tangent to the curve y = f(x) at (xo, f(X0)). 
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This tangent line exists if and only if f’(x9) exists, in which case m is uniquely determined 
by m = f'(xo) (Exercise 2.3.1). Thus, (2.3.2) is the equation of the tangent line. 


We will use the following lemma to study differentiable functions. 
Lemma 2.3.2 If f is differentiable at xo, then 
F(x) = f (xo) + [f' (0) + EQ) — x0), (2.3.3) 
where E is defined on a neighborhood of x9 and 


lim E(x) = E(xo) = 0. 
X>X0 
Proof Define 


f(x) — f (xo) ' 
DBG\= ee x € Dy andx F Xo, (2.3.4) 


0, X = Xo. 


Solving (2.3.4) for f(x) yields (2.3.3) if x # xo, and (2.3.3) is obvious if x = x9. Defini- 
tion 2.3.1 implies that lim,.,, E(x) = 0. We defined E(xo) = 0 to make E continuous 
at Xo. an 


Since the right side of (2.3.3) is continuous at x9, so is the left. This yields the following 
theorem. 


Theorem 2.3.3 /f f is differentiable at xo, then f is continuous at xo. 


The converse of this theorem is false, since a function may be continuous at a point 
without being differentiable at the point. 


Example 2.3.2 The function 


f(x) = |x| 
can be written as 
f(Qx)= x, x>0, (2.3.5) 
or as 
f(x) =-x, x <0. (2.3.6) 
From (2.3.5), 


f'@= 1, x>0, 
and from (2.3.6), 
f'@=-1, x <0. 


Neither (2.3.5) nor (2.3.6) holds throughout any neighborhood of 0, so neither can be used 
alone to calculate f’(0). In fact, since the one-sided limits 


ee CT. tae (2.3.7) 
x—0+ x—-0 x>0+ X 
and 
fe ee (2.3.8) 


x—0-— x —O0 x-0- x 
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are different, 


: f(x) — FO) 
LO 
x0 x-—0 


does not exist (Theorem 2.1.6); thus, f is not differentiable at 0, even though it is continu- 
ous at 0. 


Interchanging Differentiation and Arithmetic Operations 
The following theorem should be familiar from calculus. 


Theorem 2.3.4 If f and g are differentiable at xo, then so are f + g, f —g,and fg, 
with 
(a) (f +8)'(%o) = f'(x0) + 8! (x0): 
(b) (f —8)'(x0) = f'(X0) — g(%0); 
(c) (fg) (xo) = f’(%0)g (x0) + f(x0)g' (x0). 
The quotient f /g is differentiable at xo if g(xo) 4 0, with 
a) f' (x0) 8 (x0) — f(x0)8" (Xo) 

d — = oe oer 

(@) (2) ow (ea)? 


Proof The proof is accomplished by forming the appropriate difference quotients and 
applying Definition 2.3.1 and Theorem 2.1.4. We will prove (c) and leave the rest to you 
(Exercises 2.3.9, 2.3.10, and 2.3.11). 


The trick is to add and subtract the right quantity in the numerator of the difference 
quotient for ( fg)’ (xo); thus, 


F(x)g(x) — fxo)go) — Fx)g(x) — fo)g(x) + f (xo) g(x) — f(x) g (Xo) 
xX —Xo - xX — X90 


I(x) — f (xo) (x) + f(x) $= SOO 


& 
X— Xo X — Xo 


The difference quotients on the right approach f’(x9) and g’(xo) as x approaches xo, and 
limy—+x) g(x) = g(xo) (Theorem 2.3.3). This proves (c). au 


The Chain Rule 


Here is the rule for differentiating a composite function. 


Theorem 2.3.5 (The Chain Rule) Suppose that g is differentiable at xo and f 
is differentiable at g(xo). Then the composite functionh = f o g, defined by 


A(x) = f(g(x)), 


is differentiable at xo, with 


h'(xo) = f'(g(xo0))g" (xo). 
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Proof Since / is differentiable at g(xo), Lemma 2.3.2 implies that 


SO) — Feo) = [f'(g@o)) + EOI — go). 


where 
lim eo = E(g(xo)) = 0. 


t>g (xo 


Letting t = g(x) yields 


F(g(x)) — f(g@o)) = [f(g 0) + E(g(x)Ilg@) — g(%o)]- 


Since h(x) = f(g(x)), this implies that 


MONO) _Lp"(@(0)) + Ee) SDE, 


X —xX0QO X —X0o 


Since g is continuous at x9 (Theorem 2.3.3), (2.3.9) and Theorem 2.2.7 imply that 


Jim E(g(x)) = E(g%o)) = 0. 
Therefore, (2.3.10) implies that 
h(x) — h(xo) 


A'(xo) = lim = f'(g(x0))g' (xo), 
xXx x—Xo0 
as stated. 


Example 2.3.3 If 


f(x) =sinx and g(x) = a x £0, 


then ; 
h(x) = f(g) =sin+, x £0, 
and 
i's) = F"(@Cetx) = (cos) (-). x #0 


It may seem reasonable to justify the chain rule by writing 


A(x) ~h(xo) _ f(g(x)) — (go) 


X — Xo X — Xo 
_ S(g)) = f(g (0) B(x) — 8%) 
&(x) — (Xo) x — X9 
and arguing that 


x>x%0 g(x) — g(%o) 


(2.3.9) 


(2.3.10) 
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(because limy—+x) g(x) = g(xo)) and 


lim g(x) — g(Xxo) _ g’ (xo). 


x—>Xx0 xX — Xo 


However, this is not a valid proof (Exercise 2.3.13). 


One-Sided Derivatives 


One-sided limits of difference quotients such as (2.3.7) and (2.3.8) in Example 2.3.2 are 
called one-sided or right- and left-hand derivatives. That is, if f is defined on [xo, b), the 
right-hand derivative of f at Xo is defined to be 


. f(x) — f (xo) 
! = | 
OG In an 
if the limit exists, while if f is defined on (a, xo], the left-hand derivative of f at Xo is 
defined to be 
fm) = tim LO= LC) 
X>xQ- xX —Xo 
if the limit exists. Theorem 2.1.6 implies that / is differentiable at xo if and only if f{ (xo) 
and f’ (xo) exist and are equal, in which case 


f'(x0) = fi (%0) = fF! (x0). 
In Example 2.3.2, f/ (0) = 1 and f’(0) = —1. 


Example 2.3.4 If 


x3, x <0, 
f(x) = 1 (2.3.11) 
x*sin-, x>0, 
then 
3x2, x <0, 
f'@) = 4 1 (2.3.12) 
2xsin——cos—, x>Q0. 
x 


Since neither formula in (2.3.11) holds for all x in any neighborhood of 0, we cannot simply 
differentiate either to obtain f’(0); instead, we calculate 
1 
x? sin——0 
((0) = lim ——*— = li in— = 0, 
Fs ) pecs x —0 Penh a x 
3 


’ _ 1 7 =) : 2_<¢. 
FO) = ees x-0 ae = 


hence, f’(0) = f; (0) = f£(0) =0. | 
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This example shows that there is a difference between a one-sided derivative and a one- 
sided limit of a derivative, since f{ (0) = 0, but, from (2.3.12), f’(0+) = limy+o+ f’(x) 
does not exist. It also shows that a derivative may exist in a neighborhood of a point xo 
(= 0 in this case), but be discontinuous at xq. 


Exercise 2.3.4 justifies the method used in Example 2.3.4 to compute f’(x) for x 4 0. 


Definition 2.3.6 


(a) We say that f is differentiable on the closed interval [a,b] if f is differentiable on 
the open interval (a,b) and f{ (a) and f’(b) both exist. 


(b) We say that f is continuously differentiable on [a,b] if f is differentiable on [a, 5], 
f' is continuous on (a,b), fi (a) = f'(a+), and f'(b) = f'(b-). 


Extreme Values 


We say that f(xo) is a local extreme value of f if there is a6 > 0 such that f(x) — f(xo) 
does not change sign on 
(xo —5,x9 +6) N Dy. (2.3.13) 


More specifically, f(x9) is a local maximum value of f if 
F(x) = f(%o) (2.3.14) 


or a local minimum value of f if 


f(x) = f (x0) (2.3.15) 


for all x in the set (2.3.13). The point x9 is called a local extreme point of f, or, more 
specifically, a local maximum or local minimum point of f. 


Figure 2.3.3 
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Example 2.3.5 If 


(Figure 2.3.3), then 0, 3, and every x in (—1, —4) are local minimum points of f, while 1, 
4, and every x in (—1, —4] are local maximum points. | 


It is geometrically plausible that if the curve y = f(x) has a tangent at a local extreme 
point of f, then the tangent must be horizontal; that is, have zero slope. (For example, in 
Figure 2.3.3, see x = 1, x = 3, and every x in (—1, —1/2).) The following theorem shows 
that this must be so. 


Theorem 2.3.7 If f is differentiable ata local extreme point Xo € D®., then f'(xo) = 


Proof We will show that xo is not a local extreme point of f if f’(xo) 4 0. From 
Lemma 2.3.2, 
f(x) — f (Xo) 
X —X0 
where lim,.x, E(x) = 0. Therefore, if f’(xo) 4 0, there is a 5 > 0 such that 


= f'(xo) + E(x), (2.3.16) 


|E(x)| < |f"(x0)| if |x — xo| < 6, 


and the right side of (2.3.16) must have the same sign as f’(xo) for |x — xo| < 6. Since 
the same is true of the left side, f(x) — f(xo) must change sign in every neighborhood of 
Xo (since x — X9 does). Therefore, neither (2.3.14) nor (2.3.15) can hold for all x in any 
interval about xo. an 


If f’(xo) = 0, we say that xo is a critical point of f. Theorem 2.3.7 says that every 
local extreme point of f at which f is differentiable is a critical point of f'. The converse 
is false. For example, 0 is a critical point of f(x) = x3, but not a local extreme point. 


Rolle’s Theorem 


The use of Theorem 2.3.7 for finding local extreme points is covered in calculus, so we will 
not pursue it here. However, we will use Theorem 2.3.7 to prove the following fundamental 
theorem, which says that if a curve y = f(x) intersects a horizontal line at x = a and 
x = band has a tangent at (x, f(x)) for every x in (a,b), then there is a point c in (a, b) 
such that the tangent to the curve at (c, f(c)) is horizontal (Figure 2.3.4). 
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Figure 2.3.4 


Theorem 2.3.8 (Rolle’s Theorem) Suppose that f is continuous on the closed 
interval [a,b] and differentiable on the open interval (a,b), and f(a) = f(b). Then 
J '(c) = 0 for some c in the open interval (a, b). 


Proof Since f is continuous on [a,b], f attains a maximum and a minimum value on 
[a, b] (Theorem 2.2.9). If these two extreme values are the same, then f is constant on 
(a,b), so f’(x) = 0 for all x in (a, b). If the extreme values differ, then at least one must 
be attained at some point c in the open interval (a,b), and f’(c) = 0, by Theorem 2.3.7. 
O 


Intermediate Values of Derivatives 


A derivative may exist on an interval [a, b] without being continuous on [a, b]. Neverthe- 
less, an intermediate value theorem similar to Theorem 2.2.10 applies to derivatives. 


Theorem 2.3.9 (Intermediate Value Theorem for Derivatives) Suppose 
that f is differentiable on |a, b], f'(a) # f'(b), and yu is between f'(a) and f’(b). Then 
J '(c) = for some c in (a,b). 


Proof Suppose first that 


f'(a)< p< f(b) (2.3.17) 
and define 
g(x) = f(x) — px. 
Then 
g(ix=f'«%)—u, a<x<b, @3.18) 
and (2.3.17) implies that 
g(a)<0O and g/(b)>0. (2.3.19) 


Since g is continuous on [a, b], g attains a minimum at some point c in [a, b]. Lemma 2.3.2 
and (2.3.19) imply that there is a 6 > 0 such that 


g(x) < g(a), a<x<a+é, and g(x)<g(b), bD-éb<x<b 
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(Exercise 2.3.3), and therefore c # a andc # b. Hence, a < c < bd, and therefore 
g'(c) = 0, by Theorem 2.3.7. From (2.3.18), f’(c) = p. 


The proof for the case where f’(b) < yu < f’(a) can be obtained by applying this result 
to—f. q 


Mean Value Theorems 


Theorem 2.3.10 (Generalized Mean Value Theorem) [f f and g are con- 
tinuous on the closed interval |a, b] and differentiable on the open interval (a, b), then 


[g(b) — g(@|f'(c) = [f) — F@ls'(c) (2.3.20) 
for some c in (a,b). 
Proof The function 
h(x) = [g(b) — g@| f(x) —[f) — F@|s) 
is continuous on [a, b] and differentiable on (a, b), and 
h(a) = h(b) = gb) f(a) — f)g@). 
Therefore, Rolle’s theorem implies that h’(c) = 0 for some c in (a, b). Since 
h'(c) = [g(b) — g@l|f'(c) — [f) — f@ls'), 

this implies (2.3.20). an) 

The following special case of Theorem 2.3.10 is important enough to be stated separately. 


Theorem 2.3.11 (Mean Value Theorem) /f f is continuous on the closed 
interval [a, b] and differentiable on the open interval (a, b), then 


fo)- f@ 
b 


—a 


fc) = 
for some c in (a,b). 


Proof Apply Theorem 2.3.10 with g(x) = x. 
0 


Theorem 2.3.11 implies that the tangent to the curve y = f(x) at (c, f(c)) is parallel to 
the line connecting the points (a, f(a)) and (b, f(b)) on the curve (Figure 2.3.5, page 84). 


Consequences of the Mean Value Theorem 


If f is differentiable on (a,b) and x1, x2 € (a,b) then f is continuous on the closed 
interval with endpoints x; and x2 and differentiable on its interior. Hence, the mean value 
theorem implies that 

f (x2) — fer) = f'©)@2 — x1) 
for some c between x, and x2. (This is true whether x; < x2 or x2 < x .) The next three 
theorems follow from this. 


84 Chapter 2 Differential Calculus of Functions of One Variable 


Theorem 2.3.12 If f’(x) = 0 forall x in (a,b), then f is constant on (a,b). 


Theorem 2.3.13 If f’ exists and does not change sign on (a,b), then f is monotonic 
on (a, b) : increasing, nondecreasing, decreasing, or nonincreasing as 


fix) >0, f(x) =0, f(x) <0, or f'(x) <0, 


respectively, for all x in (a, b). 


Theorem 2.3.14 [f 
[f'(x)| <M, a<x <b, 
then 
| f(x) — f(x)| < M|x—x'|], x, x’ € (a,b). (2.3.21) 


A function that satisfies an inequality like (2.3.21) for all x and x’ in an interval is said 
to satisfy a Lipschitz condition on the interval. 


f@ 


Figure 2.3.5 


2.3 Exercises 


1. Prove that a function f is differentiable at xo if and only if 


fim LOL = fo) = me = x0) _ 
1 SCO 
X>X0 X—X9 


0 


for some constant m. In this case, f’(x9) = m. 
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Prove: If f is defined on a neighborhood of xo, then f is differentiable at xo if and 
only if the discontinuity of 


_ fQ)= FO) 


X —X0QO 


h(x) 


at Xo is removable. 


Use Lemma 2.3.2 to prove that if f’(xo) > 0, there is a 6 > 0 such that 


F(x) < f(xo) if x9 —6 <x < xo and f(x) > f(xo) if x9 <x <x04+6. 


Suppose that p is continuous on (a, c] and differentiable on (a,c), while g is con- 
tinuous on [c, b) and differentiable on (c, b). Let 


p(x), a<x<c, 
ae q(x), C<x <b. 
(a) Show that 
; p(x), a<x<c, 
Fe= aes c<x <b, 


(b) Under what additional conditions on p and q does f’(c) exist? Prove that 
your stated conditions are necessary and sufficient. 


Find all derivatives of f(x) = x”—!|x|, where n is a positive integer. 


Suppose that f’(0) exists and f(x + y) = f(x) f(y) for all x and y. Prove that f’ 
exists for all x. 


Suppose that c’(0) = a and s’(0) = b where a” + b? # 0, and 


c(x + y) = e(x)e(y) — s(x)s(y) 
s(x + y) = s(x)e(y) + c(x)s(y) 


for all x and y. 


(a) Show that c and s are differentiable on (—oo, 00), and find c’ and s’ in terms 
of c, s,a, and b. 


(b) (For those who have studied differential equations.) Find c and s explicitly. 


(a) Suppose that f and g are differentiable at xo, f(xo) = g(xo) = 0, and 
g' (xo) # 0. Without using L Hospital’s rule, show that 


im £6) — £'@0) 
x>x0 g(x) _g/(X0) 


(b) State the corresponding results for one-sided limits. 
Prove Theorem 2.3.4(a). 


86 


10. 
11. 
12. 


13. 


14. 


15. 


16. 


17. 


18. 


19. 
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Prove Theorem 2.3.4(b). 
Prove Theorem 2.3.4(d). 
Prove by induction: Ifn > 1 and f (x9) and g™ (x9) exist, then so does (fg) (x9), 
and 

ce 

(fg) (xo) = i ( J Peres. 
m 
m=0 

HINT: See Exercise 1.2.19. This is Leibniz’s rule for differentiating a product. 


What is wrong with the “proof” of the chain rule suggested after Example 2.3.3? 
Correct it. 


Suppose that f is continuous and increasing on [a,b]. Let f be differentiable at a 

point xo in (a,b), with f’(xo) # 0. If g is the inverse of f Theorem 2.2.15), show 

that g’( f(x0)) = 1/f" (x0). 

(a) Show that f{ (a) = f’(a+) if both quantities exist. 

(b) Example 2.3.4 shows that F{(@) may exist even if f’(a+) does not. Give an 
example where f’(a+) exists but f/ (a) does not. 

(c) Complete the following statement so it becomes a theorem, and prove the 
theorem: “If f’(a+) exists and f is_____ at. a, then f{ (a) = f'"(a+).” 

Show that f(a+) and f(b—) exist (finite) if f’ is bounded on (a,b). HINT: See 

Exercise 2.1.38. 

Suppose that f is continuous on [a,b], f{ (a) exists, and jz is between f{ (a) and 

(f(b) — f@)/(6 — a). Show that f(c) — f(a) = w(c —a) for some c in (a, D). 

Suppose that f is continuous on [a,b], fj (a) < uw < f!(b), and 


(f6) — fay)/(b — a) Fb. 


Show that either f(c) — f(a) = w(c —a) or f(c) — f(b) = (c — db) for some c 
in (a, b). 
Let . 

sin x 


f@x= , x #0. 


x 


(a) Define (0) so that f is continuous at x = 0. HINT: Use Exercise 2.3.8. 
(b) Show that if ¥ is a local extreme point of f, then 


Lf Gx)| = 1 + x2). 


HINT: Express sinx and cos x in terms of f(x) and f'(x), and add their 
squares to obtain a useful identity. 


(c) Show that | f(x)| < 1 for all x. For what value of x is equality attained? 


20. 


21. 


22. 


23. 


24. 


25. 


Section 2.3 Differentiable Functions of One Variable 87 


Let n be a positive integer and 


f(x) = ee x #kn (k = integer). 


(a) Define f(kz:) so that f is continuous at kz. HINT: Use Exercise 2.3.8. 
(b) Show that if ¥ is a local extreme point of f, then 


If@)| = [1 + (n? —1) sin? x] 7. 


HINT: Express sinnx and cosnx in terms of f(x) and f'(x), and add their 
squares to obtain a useful identity. 
(c) Show that | f(x)| < 1 for all x. For what values of x is equality attained? 


We say that f has at least n zeros, counting multiplicities, on an interval J if there 
are distinct points x1, X2,..., Xp in J such that 


f (xi) = 0, O0<j<nj-1, l<ix<p, 


and nj +-+-:+Np =n. Prove: If f is differentiable and has at least n zeros, 
counting multiplicities, on an interval J, then f’ has at least n — 1 zeros, counting 
multiplicities, on /. 


Give an example of a function f such that f’ exists on an interval (a, b) and has a 
jump discontinuity at a point xo in (a, b), or show that there is no such function. 


Let x1, X2,..., Xn and y1, yo, ..., Yn be in (a,b) and y; < x;,1 <i <n. Show 
that if f is differentiable on (a, b), then 


Ye) -— FO = F'O D5 @ - yw) 
i=1 i=1 
for some c in (a, D). 


Prove or give a counterexample: If f is differentiable on a neighborhood of xo, then 
f satisfies a Lipschitz condition on some neighborhood of xo. 


Let 
Sf") + p(x) f(x) =0 and g"(x) + pix)g(x) =0, a<x<b. 


(a) Show that W = f’g — fg’ is constant on (a,b). 


(b) Prove: If W 4 Oand f(x1) = f(x2) = 0 where a < x1 < x2 < J, then 
g(c) = 0 for some c in (x1, X2). HINT: Consider f/g. 
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26. 


27. 


28. 


Suppose that we extend the definition of differentiability by saying that f is differ- 
entiable at Xo if 


f'(xo) = lim F(x) — Fo) 


xX—>Xx0 xX—Xo 


exists in the extended reals. Show that if 


al X x>0, 


PI Va ieee a Gp 


then f’(0) = oo. 
Prove or give a counterexample: If f is differentiable at xo in the extended sense of 
Exercise 2.3.26, then f is continuous at x9. 


Assume that f is differentiable on (—oo, oo) and xo is a critical point of f. 


(a) 


(b) 


(c) 


(d) 


(e) 


Let h(x) = f(x)g(x), where g is differentiable on (—oo, oo) and 
S(x0)g' (x0) # 0. 


Show that the tangent line to the curve y = h(x) at (xo, A(xo)) and the tangent 
line to the curve y = g(x) at (Xo, g(Xo) intersect on the x-axis. 

Suppose that f(xo) # 0. Let h(x) = f(x)(x — x1), where x, is arbitrary. 
Show that the tangent line to the curve y = h(x) at (xo, h(xo)) intersects the 
X-axis at ¥ = x1. 

Suppose that f(xo) 4 0. Let h(x) = f(x)(x — x1)”, where x1 4 Xo. Show 
that the tangent line to the curve y = h(x) at (xo, A(xo)) intersects the x-axis 
at the midpoint of the interval with endpoints x9 and x}. 

Let h(x) = (ax? + bx +c)(x — x1), where a # 0 and b? — 4ac # 0. Let 


Xo = ——. Show that the tangent line to the curve y = h(x) at (xo, A(xo)) 


a 
intersects the x-axis at ¥ = x}. 


Let h be a cubic polynomial with zeros a, 6, and y, where a and £ are distinct 


and y is real. Let x9 = ee. Show that the tangent line to the curve 


y = h(x) at (xo, h(Xo)) intersects the axis at ¥ = y. 


2.4 L°-HOSPITAL’S RULE 


The method of Theorem 2.1.4 for finding limits of the sum, difference, product, and quo- 
tient of functions breaks down in connection with indeterminate forms. The generalized 
mean value theorem (Theorem 2.3.10) leads to a method for evaluating limits of indetermi- 


nate forms. 


Theorem 2.4.1 (L’Hospital’s Rule) Suppose that f and g are differentiable 
and g’ has no zeros on (a, b). Let 


lim f(xa= _ g(x) =0 (2.4.1) 
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or 
lim f(x) =+00 and lim g(x) = £00, (2.4.2) 
x—>b— x—>b— 
and suppose that 
/ 
ee” =a. toutes, (2.4.3) 
x—>b— g' (x) 
Then 
re Acs eg (2.4.4) 
x—>b— g(x) 


Proof We prove the theorem for finite L and leave the case where L = +oo to you 
(Exercise 2.4.1). 


Suppose that « > 0. From (2.4.3), there is an x9 in (a, b) such that 


f'©) 
g'(c) 


Theorem 2.3.10 implies that if x and ¢ are in [xo, b), then there is a c between them, and 
therefore in (xo, b), such that 


[g(x) — g@IS'(c) = [F@) — FOS’). (2.4.6) 


Since g’ has no zeros in (a, b), Theorem 2.3.11 implies that 


g(x)-—g(t) 40 if x,te(,b). 


—L 


<e if x9<c <b. (2.4.5) 


This means that g cannot have more than one zero in (a, b). Therefore, we can choose x9 
so that, in addition to (2.4.5), g has no zeros in [xo, b). Then (2.4.6) can be rewritten as 


fe-£0 _ £0 
g(x)—g(t) —g’(c) 


so (2.4.5) implies that 


fO-fO_ 


Dako Ll <e if x,t € [xo,b). (2.4.7) 


If (2.4.1) holds, let x be fixed in [x9, b), and consider the function 


f@)-fO 
a 
= a) — 80) 
From (2.4.1), 
pe ft) = pate g(t) =0, 
sO 


FQ) _ 
g(x) 


lim G(t) = ie (2.4.8) 
t—b— 
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Since 
IG(t)|<e if x <t <b, 


because of (2.4.7), (2.4.8) implies that 
fx) 
g(x) 
This holds for all x in (xo, b), which implies (2.4.4). 


The proof under assumption (2.4.2) is more complicated. Again choose x9 so that (2.4.5) 
holds and g has no zeros in [xo, b). Letting tf = xo in (2.4.7), we see that 


F(x) — fo) _ 
g(x) — g(xo) 


Since lim,.,— f(x) = +00, we can choose x1 > Xo so that f(x) 4 Oand f(x) # f(xo) 
if xy < x <b. Then the function 


<eE 


L| <e if x9 <x <b. (2.4.9) 


_ 1=8(%o)/e@) 
I= feo)/ F(a) 


is defined and nonzero if x; < x < b, and 


u(x) 


lim u(x) = 1, (2.4.10) 


x—>b— 


because of (2.4.2). 


Since 
f(x) = fo) _ f@) 1= feod/fO) _ _ f@) 
g(x)— (xo) = (x) 1—g(xo)/g(x) — g(x)u(x)’ 
(2.4.9) implies that 
f(x) 


g(x)u(x) 


Ll<e if x1 <x<b, 


which can be rewritten as 
f(x) 
g(x) 
From this and the triangle inequality, 
fo) |_| f@ 
g(x) g(x) 
Because of (2.4.10), there is a point x2 in (x1, D) such that 


— Lu(x)| <elu(x)| if x1<x <b. (2.4.11) 


< 


— Lu(x)| + |Lu(x) — L| < €lu(x)| + |Z] Ju@v) -— 1]. (2.4.12) 


ju(x) -—1]<e andtherefore |u(x)|<l+e if x.<x <b. 
This, (2.4.11), and (2.4.12) imply that 


fx) 


=e & 
g(x) 


<e(lte)+|Lle if x2<x <b, 
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which proves (2.4.4) under assumption (2.4.2). an 


Theorem 2.4.1 and the proof given here remain valid if b = oo and “x — b—” is 
replaced by “x —> oo” throughout. Only minor changes in the proof are required to show 
that similar theorems are valid for limits from the right, limits at —oo, and ordinary (two- 
sided) limits. We will take these as given. 


The Indeterminate Forms 0/0 and co/co 
We say that f/g is of the form 0/0 as x > b—if 
lim f(x) = lim g(x) =0, 
x—>b— x—>b— 
or of the form co/oo as x + b—if 
lim f(x) = +00 
x—b— 


and 
lim g(x) = +00. 
x—>b— 
The corresponding definitions for x — b+ and x > +oo are similar. If f/g is of one of 


these forms as x — b— and as x —> b+, then we say that it is of that form as x > b. 


Example 2.4.1 The ratio sinx/x is of the form 0/0 as x > 0, and LHospital’s rule 
yields 


Example 2.4.2 The ratio e-*/x is of the form 00/00 as x > —oo, and L’Hospital’s 
tule yields 
e* —e* 
lim —= lim 
xX—>-00 X xX——00 


= —-o. 


Example 2.4.3 Using L Hospital’s rule may lead to another indeterminate form; thus, 


x ex 


lim —= lim — 
x00 x2 x00 2x 


if the limit on the right exists in the extended reals. Applying L’ Hospital’s rule again yields 


e* e* 
lim —= lim —=o. 
x00 2x x—->oo 2 
Therefore, 
x 
e 
lim —~ = co 
x00 x2 
More generally, 
ex 
lim —=oo 
x00 x 


for any real number a (Exercise 2.4.33). 
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Example 2.4.4 Sometimes it pays to combine L’Hospital’s rule with other manipula- 
tions. For example, 


_ 4—4cosx —2sin? x . 4sinx —4sinx cos x 
lim —>,—_ = lim ——— 3 
x0 x x0 4x 


. sinx . l—-cosx 
lim lim ———— 
x30 Xx x>0 8x2 

_ sinx _ sinx 
=| lim lim 
x>0 X x30 2x 


Lay : (E le 2.4.1) 
=r =r xample 2.4.1). 
2 2 


As another example, L’ Hospital’s rule yields 
; ex log(1 + x) ; —2xe-*” log + x) + er (1 +x) 
Lin AAS. = Sr Re = 
x0 x x0 1 


However, it is better to remove the “determinate” part of the ratio before using L Hospital’s 
rule: 


: ee log(l+%)  /[.. .-2 . logd+-x) 
lim ————————__ = | lime lim. ———_—_ 


x0 x x0 x0 x 
log 
= (1) lim log( + x) 
x0 x 
1/d 
= lim 1 +x) = 1. | 
x0 1 
In using L’Hospital’s rule we usually write, for example, 
/ 
fi ie (2.4.13) 


xb g(x) xb gi (x) 
and then try to find the limit on the right. This is convenient, but technically incorrect, since 
(2.4.13) is true only if the limit on the right exists in the extended reals. It may happen that 
the limit on the left exists but the one on the right does not. In this case, (2.4.13) is incorrect. 
Example 2.4.5 If 


1 
f(x) =x—x?sin— and g(x) =sinx, 
x 


then i j 
f'(x) =1-2xsin—+cos— and g'(x) =cosx. 
x x 
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Therefore, lim, 9 f’(x)/g’ (x) does not exist. However, 


F(x) . l-xsind/x) 1 
= lim —————— = - = 1. 
x>0 g(x) x0 (sinx)/x 1 


The Indeterminate Form 0-00 


We say that a product fg is of the form 0 -0o as x — b—if one of the factors approaches 


0 and the other approaches +oo as x — b—. In this case, it may be useful to apply 
L Hospital’s rule after writing 


fis)ets) = FO or forge = SO. 


since one of these ratios is of the form 0/0 and the other is of the form oo/oo as x > b-. 


Similar statements apply to limits as x > b+, x > b, and x > +oo. 


Example 2.4.6 The product x log x is of the form 0 - co as x > 0+. Converting it to 
an 0o/co form yields 


log x 


pai ? oe» = ne 1/x 
at 1/x 
= soe —1/x? 


=—-— lim x =0. 
x->0+ 


Converting to a 0/0 form leads to a more complicated problem: 


li 1 = lim —— 
soe PE ere 1/ log x 


1 
= ine 
x>0+ —1/x(logx)? 


— li logx)? =? 
eee 


Example 2.4.7 The product x log(1+1/x) is of the form 0-00 as x — oo. Converting 
it to a 0/0 form yields 


log(1 + 1/x) 
1/x 


in WL + V2 C1/2?) 
= hn ——— 


X00 —1/x? 


lim xlog(1 + 1/x) = lim 
x—oo x—>0oO 


1 
= lim —— = 
x00 1+ 1/x 
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In this case, converting to an co/0co form complicates the problem: 


Xx 
lim xlog(1 + 1/x) = lim ————_— 
ih loeb ie) Su 1/log(1 + 1/x) 


. 1 
= lim 


ia ecard (rare 


tim x(x + I)flogd + 1/x)P? =? 


The Indeterminate Form oo — co 
A difference f — g is of the form co — co as x > b—if 
lim f(x) = lim g(x) = too. 
x—>b— x—>b— 


In this case, it may be possible to manipulate f — g into an expression that is no longer 
indeterminate, or is of the form 0/0 or oo /0o as x — b—. Similar remarks apply to limits 
as x > b+,x > b,orx > too. 


Example 2.4.8 The difference 


is of the form co — co as x —> 0, but it can be rewritten as the 0/0 form 


sinx — x 
x2 
Hence, 
: sin x 1 . sinx—x cosx —1 
lim ——j)]= lim = 
x—>0 x2 x x—>0 x2 x—>0 2% 
_ —sinx 
= li = 0. 
x0 
Example 2.4.9 The difference 
Fee 


is of the form oo — oo as x —> ov. Rewriting it as 


1 
rea) 
x 
which is no longer indeterminate as x — oo, we find that 
2 ao 1 
lim (x* —x) = lim x*[1-——- 
X00 X—>00 Xx 


; o\ 1 
= (Jim x?) lim 1-- 
x00 x00 x 


= (co)(1) = 0 
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The Indeterminate Forms 0°, 1°, and ov? 
The function f* is defined by 
FRO = CFOS = exp(g(x) log f(x) 
for all x such that f(x) > 0. Therefore, if f and g are defined and f(x) > 0 on an interval 
(a, b), Exercise 2.2.22 implies that 


lim [FOF = exp ( lim g(x) log fes)) (2.4.14) 


if lim,_.,— g(x) log f(x) exists in the extended reals. (If this limit is +00 then (2.4.14) is 
valid if we define e~° = 0 and e® = oo.) The product g log f can be of the form 0 - oo 
in three ways as x —> b-: 


(a) Iflimy+»— g(x) = 0 and lim,.,— f(x) = 0. 
(b) Iflimy_.,— g(x) = +00 and lim,_,,— f(x) = 1. 
(c) Iflim,—,— g(x) = 0 and lim,_,,_ f(x) = oo. 


In these three cases, we say that f® is of the form 0°, 1°, and 00°, respectively, as x > 
b—. Similar definitions apply to limits as x > b+, x > b, and x > +00. 


Example 2.4.10 The function x* is of the form 0° as x > 0+. Since 
xe = ex losx 
and lim, 0+ x log x = 0 (Example 2.4.6), 
lim x* =e®=1. 


x>0+ 


Example 2.4.11 The function x!/@—) is of the form 1° as x — 1. Since 


and 


it follows that 


lim x!/@-) = el =e, 
x>1 


Example 2.4.12 The function x!/* is of the form 00° as x > oo. Since 


it 
He exe (“*) 
x 


and 
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it follows that 


1. 


lim x!/* = e® =1, 


x—>0o 


2.4 Exercises 


Prove Theorem 2.4.1 for the case where lim,_,p— f’(x)/g'(x) = oo. 


In Exercises 2.4.2—2.4.40, find the indicated limits. 


25. 


27. 


29. 


: 1—cosx 1+cosx 

-1 3. lim ————— . ee 
lim = x0 log(1 + x?) - x>0+ ex—1 
x>0 sin”! x 
Gm sinnx 6 igs log(1 + x) oti p¥ tne 
x—>x sinx x—>0 x entree 
lim x sin(1/x) 9. lim Jx(e7'/* —1) 10. lim tanxlogx 
x00 X00 x>0+ 


lim sin x log(| tan x|) 
xT 

lim (Vx + 1 — Vx) 
x—0O 

lim (cot x — csc x) 
x0 

lim | sin x|"* 

xT 

lim | sin x|* 

x0 

sin(1/x) 


lim x 
xX 


lim x* log x 
x>0+ 


_ (log x)F 
lim _——— 


x00 x 


lim (x* — log x) 
x—-0oO 


12. 


14. 


16. 


18. 


20. 


22. 


24. 


26. 


28. 


30. 


1 
lim E + log(tan »| 
+1 x 


lim | tan x|°°S* 
x>1/2 


lim(1 + x)!/* 
x0 


; ( x =) 
lim | ————— — — 
x>0\1l—cosx x 


log(log x) 
xe sin(x —e) 


. (- +1 
lim 
x>1+\x-1 


lim (cosh x — sinh x) 
x—>0oO 


a 


: 2, 
lim e* sin(e*) 
x—>—CO 


31. 


33. 


35. 


37. 


38. 


39. 


40. 
41. 


42. 


43. 
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sinx — x + x3/6 
lim x(x + 1) [log] +1/x)P? 32. m OS Ee 


x—>0 x? 
oe 34. lim e™"* cos x 
m — x—>37/2- 
X>OO X 
x* 
: a 36. lim 
im, (log x)" log(log x) xo x log x 
lim (sin x)""* 
x>n1/2 
n 
= sy xr! 
lim ae (n = integer > 1) 
x0 xn 
x2r tl 
sinx — 
yen “Gr+D! +1)! 
Li, Stee ———— = ego = 0 
gre 
lim =0 (n = integer) 


x20 x” 


(a) Prove: If f is continuous at xo and limy_.x, f’(x) exists, then f’(xo) exists 


and f’ is continuous at x9. 


(b) Give an example to show that it is necessary to assume in (a) that f is con- 


tinuous at Xo. 
The iterated logarithms are defined by Lo(x) = x and 
Ly(x) = log(Ln-1(*)), x >adn, n=l, 
where a, = O and ay, = e*"—!,n > 1. Show that 
(a) La(x) =Ly-i(logx), x >an, n>. 
(b) Ln—-1(a4n+) = 0 and Ly(an+) = — 
(c) lim | (Ln—-1x))* Ln(~) = Oifa>Oandn > 1. 
xan 
(d) lim (Ln(x))%/Ln—-1(x) = 0 if @ is arbitrary andn > 1. 
x—0O 
Let f be positive and differentiable on (0, oo), and suppose that 
in 
x00 f(x) 
Define fo(x) = x and 


=L, where 0<L<ow. 


fa(x) = f (fr-1(®)), n=l. 
Use L’ Hospital’s rule to show that 


an fal" 
x00 Sn-1 (x) 


=oco if a>O and n=l. 
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4A. Let f be differentiable on some deleted neighborhood N of xo, and suppose that f 
and f’ have no zeros in N. Find 


(a) lim | f(x)|7™ if lim f(x) = 0; 
x>x0 x>X0 

(b) lim [f(x)[/Y%@- if lim f(x) = 1; 
x>X0 Xx>X0 

(c) fim | f0)|"7 iflimy sx f(x) = 00. 


45. Suppose that f and g are differentiable and g’ has no zeros on (a, b). Suppose also 
that lim,.,— f’(x)/g’(x) = L and either 


lim f(x) = lim g(x) =0 
x—>b— x—>b— 


or 
lim f(x) =oo and lim g(x) = +00. 
x—>b— x—>b— 


Find lim,_,,_(1 + f(x) /e@ : 


46. We distinguish between co- 00 (= 00) and (—oo)oo (= —oo) and between oo + co 
(= oo) and —oco — co (= —oo). Why don’t we distinguish between 0 - oo and 
0 - (—00), 00 — co and —oo + 00, 00/00 and —oo/oo, and 1° and 17°? 


2.5 TAYLOR’S THEOREM 


A polynomial is a function of the form 
P(x) = do + ay (x — X0) + +++ + an(x — Xo)", (2.5.1) 


where do, ..., dn and Xo are constants. Since it is easy to calculate the values of a polyno- 
mial, considerable effort has been devoted to using them to approximate more complicated 
functions. Taylor’s theorem is one of the oldest and most important results on this question. 


The polynomial (2.5.1) is said to be written in powers of x — Xo, and is of degree n if 
adn # 0. If we wish to leave open the possibility that an = 0, we say that p is of degree 
<n. In particular, a constant polynomial p(x) = do is of degree zero if ao 4 0. If 
ag = 0, so that p vanishes identically, then p has no degree according to our definition, 
which requires at least one coefficient to be nonzero. For convenience we say that the 
identically zero polynomial p has degree —oo. (Any negative number would do as well as 
—oo. The point is that with this convention, the statement that p is a polynomial of degree 
<n includes the possibility that p is identically zero.) 


Taylor Polynomials 


We saw in Lemma 2.3.2 that if f is differentiable at xo, then 


f(x) = f(xo) + f'(xo)(x — xo) + E(x)(% — 0), 
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where 
lim E(x) = 0. 
xXx>XO 


To generalize this result, we first restate it: the polynomial 
Ti (x) = f (xo) + f'(%o)(x — x0), 
which is of degree < | and satisfies 
Ti (x0) = f(Xo), Ty(xo) = f’(Xo), 
approximates f so well near xo that 


km £AV— TG) _ 
im ——————— = 


X—>Xx0 x—Xo 


0. (2.5.2) 


Now suppose that f has n derivatives at xo and T,, is the polynomial of degree < n 
such that 
TA (xo) = fo), OST sa. (2.5.3) 


How well does T, approximate f near x9? 


To answer this question, we must first find 7;,. Since T;, is a polynomial of degree < n, 
it can be written as 


Tn(x) = do + a(x — X90) +++: + an(x — x0)", (2.5.4) 
where do, ..., dy are constants. Differentiating (2.5.4) yields 
T.'(x9) =rlar, OST <n, 


so (2.5.3) determines a, uniquely as 


ar = FOC) O<r<n. 
r! 
Therefore, 
! (n) 
T(x) = f(xo) + f Co) (x — Xo) ee + £ 0) (x Xo)” 


i (r) 
= 2 fo) 0) (x = xo)’. 
r=0 . 


We call T;,, the nth Taylor polynomial of f about xo. 


The following theorem describes how 7, approximates f near Xo. 


Theorem 2.5.1 If f™ (xo) exists for some integern > 1 and Ty is the nth Taylor 
polynomial of f about xo, then 


f(x) = Tn) ='6 


Pre (x — x0)" = (2.5.5) 
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Proof The proof is by induction. Let P, be the assertion of the theorem. From (2.5.2) 
we know that (2.5.5) is true ifm = 1; that is, P; is true. Now suppose that P, is true for 
some integer n > 1, and f+ exists. Since the ratio 


f(*) = Tn41@) 


(x = xo)?+1 
is indeterminate of the form 0/0 as x > xo, L-Hospital’s rule implies that 
_T, 1 "(x) — Tl (x 
ieee ee) fig 2 ee) (2.5.6) 
x>x9  (X —Xq)?t+! n+1x>xo (x — xo)” 


if the limit on the right exists. But f’ has an nth derivative at xo, and 


nt (r+1) 
Ty41(X) = > PO « =x)" 


r=0 


is the nth Taylor polynomial of f’ about xo. Therefore, the induction assumption, applied 
to f’, implies that 
f= TG) 


x>x0 (x — Xo)” 


0. 


This and (2.5.6) imply that 


x>x0 (xX — xo)?+1 
which completes the induction. q 


It can be shown (Exercise 2.5.8) that if 
Pn = do + a1 (xX — X0) + +++ + Gn(X — Xo)” 


is a polynomial of degree < n such that 


‘ay I(x) — Pn(x) = 


li F 
x—>XxQ (x = Xo)” 
then 
f (x0) 
p= —] 
r! 


that is, Pn = Ty. Thus, T;, is the only polynomial of degree < n that approximates f near 
Xo in the manner indicated in (2.5.5). 


Theorem 2.5.1 can be restated as a generalization of Lemma 2.3.2. 


Lemma 2.5.2 If f(x) exists, then 
le (r) 
f(x) = ¥, cae? — x0)" + En(x)(x — xo)”, (2.5.7) 
r=0 ms 


where 
lim E,(x) = En(xo) = 0. 
x—>X0O 
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Proof Define 


F(x) — Th(x) 
E,(x) = (x — Xo)” 
0, X = Xo. 


, x € De —{xo}, 


Then (2.5.5) implies that lim, ) En(x) = En(xo) = 0, and it is straightforward to verify 
(23.7). 0 


Example 2.5.1 If f(x) = e*, then f(x) = e*. Therefore, f™(0) = 1 forn > 0, 
so the nth Taylor polynomial of f about x9 = 0 is 


nt r 2 n 


x x Xx 
PC) =) att ho ee ae (2.5.8) 
r=0 
Theorem 2.5.1 implies that 
n r 
er — aa 
r} 
lim it =0 
x0 x” 


(See also Exercise 2.4.38.) 
Example 2.5.2 If f(x) = logx, then f(1) = 0 and 
— 1)! 
fO@ =CyrMLD +21, 
x’ 


so the nth Taylor polynomial of f about xp = 1 is 


Tn(x) = > Seay 
r=1 


r 


ifn > 1. (To = 0.) Theorem 2.5.1 implies that 


n 
log x — 2 (1) r@=1) 
é r=1 
SE > 
1» (x —1)" Oho eds 


Example 2.5.3 If f(x) = (1+ x)%, then 


f@=qd ty 
f") =qq-DO+x)%? 


fM@) =qq-D--@-n+D)04x)9". 


102 Chapter 2 Differential Calculus of Functions of One Variable 


(7) =: - (7) - tober, see 
0 n n!} 

f™O) _ fa 

ni Nay’ 


and the nth Taylor polynomial of f about 0 can be written as 


Ta(x) =~ (")». (2.5.9) 


r=0 


If we define 


then 


Theorem 2.5.1 implies that 


G+ x)? -— > (")« 


' r=0 
lim 
x0 xn 


=0, n>0. | 


If g is a nonnegative integer, then @ is the binomial coefficient defined in Exer- 
n 
cise 1.2.19. In this case, we see from (2.5.9) that 


Tr(x) = (+x)? = fx), n2q. 


Applications to Finding Local Extrema 

Lemma 2.5.2 yields the following theorem. 

Theorem 2.5.3 Suppose that f has n derivatives at xo and n is the smallest positive 
integer such that f (xo) 4 0. 

(a) Ifn is odd, Xo is not a local extreme point of f. 

(b) Jfn is even, xo is a local maximum of f if f™ (xo) < 0, ora local mininum of f if 


f™ (xo) > 0. 


Proof Since f(x) = 0 for 1 <r <n —1, (2.5.7) implies that 


(n) 
F(x) — f(x) = ae + Fat) (x — xo)” (2.5.10) 


in some interval containing xo. Since limy.x,) E,(x) = 0 and f™ (x0) # 0, there is a 
5 > 0 such that 


|En(x)| < 


(n) 
— if |x —xo| <6. 
n! 
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This and (2.5.10) imply that 
LO) = fo) (2.5.11) 
(x — Xo)” 


has the same sign as f(x) if 0 < |x — xo| < 4. If n is odd the denominator of (2.5.11) 
changes sign in every neighborhood of x9, and therefore so must the numerator (since the 
ratio has constant sign for 0 < |x — xo| < 6). Consequently, f(xo) cannot be a local 
extreme value of f. This proves (a). If n is even, the denominator of (2.5.11) is positive 
for x # xo, so f(x) — f(xo) must have the same sign as f (xg) for 0 < |x — xo| < 8. 
This proves (b). i 
For n = 2,(b) is called the second derivative test for local extreme points. 
Example 2.5.4 If f(x) = e*°, then a= 3x2e**, and 0 is the only critical point 
of f. Since 
” 4) x3 
fo (x) = (6x + 9x" )e 
and 

f(x) = (6 + 54x3 +27x%)e**, 

ft’ (0) = Oand f’”"(0) # 0. Therefore, Theorem 2.5.3 implies that 0 is not a local extreme 


point of f. Since f is differentiable everywhere, it has no local maxima or minima. 


Example 2.5.5 If f(x) = sinx”, then f’(x) = 2x cos x?, so the critical points of f 


are 0 and +,/(k + 1/2)a,k =0,1,2,.... Since 


f(x) = 2cos x? — 4x? sin x?, 
f"(0) =2 and f” (+ (k + 1/2)7)) = (-1)F+1(4k + 2)z. 


Therefore, Theorem 2.5.3 implies that f attains local minima at 0 and +,/(k + 1/2)z for 
odd integers k, and local maxima at +./(k + 1/2)z for even integers k. 


Taylor’s theorem 


Theorem 2.5.1 implies that the error in approximating f(x) by T,(x) approaches zero 
faster than (x — xo)” as x approaches x9; however, it gives no estimate of the error in 
approximating f(x) by T,(x) for a fixed x. For instance, it provides no estimate of the 
error in the approximation 

0.1 (0.1)? 


0.1 ~, _ Maes 
ole ROM =1+5> +5 


= 1.105 (2.5.12) 


obtained by setting n = 2 and x = 0.1 in (2.5.8). The following theorem provides a way 
of estimating errors of this kind under the additional assumption that f+ exists in a 
neighborhood of xo. 
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Theorem 2.5.4 (Taylor’s Theorem) Suppose that f+” exists on an open in- 
terval I about xo, and let x be in I. Then the remainder 


Rn(x) = f(x) — Tn (x) 
can be written as fi 0 
eg) ars 
Gan” — Xo)", 


where c depends upon x and is between x and Xo. 


Ri(x) = 


This theorem follows from an extension of the mean value theorem that we will prove 
below. For now, let us assume that Theorem 2.5.4 is correct, and apply it. 


Example 2.5.6 If f(x) = e*, then f’”"(x) = e*, and Theorem 2.5.4 withn = 2 


implies that 
x2 ecx3 
x — 
ew =1l+xt+ 7 ar 31 


where c is between 0 and x. Hence, from (2.5.12), 


’ 


c 1) 
e®! = 1.105 4 = © V 


where 0 < c < 0.1. Since 0 < e® < e®!, we know from this that 


POA 
ised 2 ise 


The second inequality implies that 


13 
et E en < 1.105, 


NYO) 
e?! < 1.1052. 


Therefore, 
1.105 < e®! < 1.1052, 


and the error in (2.5.12) is less than 0.0002. 


Example 2.5.7 In numerical analysis, forward differences are used to approximate 
derivatives. If h > 0, the first and second forward differences with spacing h are defined 
by 
Af (x) = fa +h) — f@) 
and 
A? f(x) = A[Af(@)] = Af@ +h) - Af(x) 
= f(x +2h)—2f(x +h) + f(x). 


Higher forward differences are defined inductively (Exercise 2.5.18). 


(2.5.13) 
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We will find upper bounds for the magnitudes of the errors in the approximations 


f' (x0) © Aro) oo) (2.5.14) 


and 


=e 


f" (x0) © (2.5.15) 


If f” exists on an open interval containing xo and x9 + 4, we can use Theorem 2.5.4 to 
estimate the error in (2.5.14) by writing 


" 2 
f(xo +h) = f (x0) + f'(x0)h + —— f ue (2.5.16) 


where x9 < c < Xo +h. We can rewrite (2.5.16) as 


f (xo +h) — f (xo) 
h 


plies _ f'@h = 


which is equivalent to 


Af (xo) L"@h 
; 


— f'(xo) = 5 


Therefore, 


Aro) = FG) < Moh 


where Mp2 is an upper bound for he on (Xo, Xo + be 


If f’” exists on an open interval containing xo and x9 + 2h, we can use Theorem 2.5.4 
to estimate the error in (2.5.15) by writing 


/ h? A h3 Wr 
FI (xo0 +h) = f(xo) + Af" (xo) + ae (xo) + ral (co) 
and 
‘é 2, W 4h3 Wl 
Ff (x0 + 2h) = f (xo) + 2hf'(xo) + 2h* f" (xo) + cai (c1), 


where x9 < Co < Xo +h and Xo < cy < Xo + 2h. These two equations imply that 


Fs + 28) ~ 2F 80+ hy + flo) = IP Fo) + | Fer) ~ 5.F"c0)| 


which can be rewritten as 


a 
A ao) — f"(xo) = [5f"en = 5£%c0)| h 


because of (2.5.13). Therefore, 


ee A? Pio) = 


Mu 


where M3 is an upper bound for | f””| on (xo, Xo + 2A). 
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The Extended Mean Value Theorem 


We now consider the extended mean value theorem, which implies Theorem 2.5.4 (Exer- 
cise 2.5.24). In the following theorem, a and b are the endpoints of an interval, but we do 
not assume that a < b. 


Theorem 2.5.5 (Extended Mean Value Theorem) Suppose that f is con- 
tinuous on a finite closed interval I with endpoints a and b (that is, either I = (a,b) or 
I = (b,a)), fary exists on the open interval T°, and, ifn > 0, that f’,..., f™ exist 
and are continuous at a. Then 


bs (r) (n+1) 
f(b) - > fos -ay = ae =a)! C317) 


for some c inT®. 


Proof The proof is by induction. The mean value theorem (Theorem 2.3.11) implies 
the conclusion for n = 0. Now suppose that n > 1, and assume that the assertion of the 
theorem is true with 1 eee by n — 1. The left side of (2.5.17) can be written as 


(b _ ayrt! 


= f “0 , 


for some number K. We must prove that K = f+ (c) for some c in 1°. To this end, 
consider the auxiliary function 


nm ¢(r) — art! 
h(x) os f(x) -)- Loe —a)y _ ko ar ’ 


which satisfies 


h(a) =0, h(b) =0, 


(the latter because of (2.5.18)) and is continuous on the closed interval J and differentiable 
on 7°, with 


(r+1) — wy 
h'(x) = f(x) — yo i i ai ie (2.5.19) 


n! 


Therefore, Rolle’s theorem (Theorem 2.3.8) implies that h’(b,;) = 0 for some b, in /°; 
thus, from (2.5.19), 


nl ¢(r4+1) _ yn 
f'(b1) — > f'@ a @ (by —a)y _ Pee i @) — 


n!} 
r=0 


If we temporarily write f’ = g, this becomes 


n=l ofr) Pace 
g(bi) — y z ©) (by — a)’ — ko" =0. (2.5.20) 


r=0 
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Since b; € 1°, the hypotheses on f imply that g is continuous on the closed interval J 
with endpoints a and by, g™ exists on J°, and, ifn > 1, Bp saty gv) exist and are 
continuous at a (also at 51, but this is not important). The induction hypothesis, applied to 
g on the interval J, implies that 


r ! 


nl ocr) (n) 
eb) - 0, - ay = —O, - ay" 
r=0 : 


for some c in J°. Comparing this with (2.5.20) and recalling that g = f’ yields 
K = go) = FON). 
Since c is in 7°, this completes the induction. 0 


2.5 Exercises 


—1/x? #0 
_ je > x ; 
i= 0, =), 
Show that f has derivatives of all orders on (—oo, 00) and every Taylor polynomial 
of f about 0 is identically zero. HINT: See Exercise 2.4.40. 


2. Suppose that f+ (x9) exists, and let T, be the nth Taylor polynomial of f about 
Xo. Show that the function 
f(x) = Tn(*) 


E,(x) = (x — Xo)” 
0, X = Xo, 


‘ x € Dz — {xo}, 


is differentiable at xo, and find E’, (xo). 


3. (a) Prove: If f is continuous at x9 and there are constants ag and a, such that 


_ f(x) - a0 —a1(% — Xo) _ 
nO CU 


X—>X0 x—Xo 


0, 


then a9 = f(Xxo), f’ is differentiable at xo, and f’(xo) = ay. 
(b) Give a counterexample to the following statement: If f and f’ are continuous 
at xo and there are constants do, a;, and az such that 


f(x) — ao — ay (x — x0) — a2(x — x0)? = 


lim 0, 
X>X0 (x — x0)? 
then f” (xo) exists. 
4. (a) Prove: if f”(xo) exists, then 
lim St (xo + h) = 2f (xo) =F St (xo = h) = Sf" (xo). 


h-0 h2 
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(b) Prove or give a counterexample: If the limit in (a) exists, then so does 
f’'(xo), and they are equal. 


5. A function f has a simple zero (or a zero of multiplicity 1) at xo if f is differentiable 
at x9 and f(xo) = 0, while f’(xo) 4 0. 


(a) Prove that f has a simple zero at xo if and only if 


F(x) = g(x)(x — Xo), 


where g is continuous at xo and differentiable on a deleted neighborhood of 


Xo, and g(xo) # 0. 
(b) Give an example showing that g in(a) need not be differentiable at xo. 


6. A function f has a double zero (or a zero of multiplicity 2) at xo if f is twice 
differentiable at x9 and f(xo) = f'(xo) = 0, while f’(xo) 4 0. 


(a) Prove that f has a double zero at xo if and only if 


F(X) = g(x)(x = x0), 


where g is continuous at x9 and twice differentiable on a deleted neighborhood 
of xo, g(xo) 4 0, and 


lim (x — xo)g’(x) = 0. 
xX>XO 


(b) Give an example showing that g in(a) need not be differentiable at xo. 


7. Let n bea positive integer. A function f has a zero of multiplicity n at xo if f 
is n times differentiable at xo, f(xo) = f'(xo) = --- = f@ (x0) = 0 and 
f™ (xo) # 0. Prove that f has a zero of multiplicity at xo if and only if 


F(x) = g(X)X = x0)", 


where g is continuous at x9 and n times differentiable on a deleted neighborhood of 
Xo, Z(xXo) 4 0, and 


lim (x — x9 g(x) =0, 1<j <n-1. 
x>Xx0 


HINT: Use Exercise 2.5.6 and induction. 
8. (a) Let 
O(x) = a + a4 (x — X90) +++ + On (x — Xo)” 


be a polynomial of degree < n such that 


fam 20) 
im —~—_ = 
xX—>Xx0 (x — Xo)” 


Show that a9 = a] =--- =a, = 0. 


10. 


11. 
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(b) Suppose that f isn times differentiable at x9 and p is a polynomial 
P(X) = do + ay(x — X90) + +++ + n(x — x0)” 


of degree < n such that 


2, JO=P@) _ 
x0 (x — x0)" 
Show that e 
i 
pe mal} ee if O<r<n: 
r! 


that is, p = Th, the nth Taylor polynomial of f about xo. 
Show that if f (xq) and g™) (x9) exist and 


x>x0 (X — Xo)” 


then f™ (x0) = g) (xo), O<r<n. 


(a) Let Fn, Gn, and H, be the nth Taylor polynomials about xo of f, g, and 
their product h = fg. Show that H, can be obtained by multiplying F, 
by G,, and retaining only the powers of x — xo through the nth. HINT: Use 
Exercise 2.5.8(b). 

(b) Use the method suggested by (a) to compute h (xq), r = 1,2, 3, 4. 

(i) A(x) =e*sinx, x =0 

(ii) A(x) = (coswx/2)(logx), xo =1 
(ili) AG@) =x* cee, xo— 7/2 
(iv) h(x) =(1+x) le, x =0 

(a) It can be shown that if g is n times differentiable at x and f is n times dif- 
ferentiable at g(x), then the composite function h(x) = f(g(x)) is n times 
differentiable at x and 


: or rh (NY x")? (2@)" 
10) =F COD aa FE) ES) (ee) 


r=1 
where » is over all n-tuples (71, 72,..., 7) of nonnegative integers such that 
mt+rat-est+m=r 
and 


ry t+ 2rg +++: +n), =n. 


(This is Faa di Bruno’s formula.) However, this formula is quite complicated. 
Justify the following alternative method for computing the derivatives of a 
composite function at a point xo: 
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12. 


13. 


14. 


Let F, be the nth Taylor polynomial of f about yo = g(xo), and let Gy and 
Hy, be the nth Taylor polynomials of g and h about xo. Show that H;, can 
be obtained by substituting G, into F, and retaining only powers of x — xo 
through the nth. HINT: See Exercise 2.5.8(b). 

(b) Compute the first four derivatives of h(x) = cos(sin x) at xo = 0, using the 
method suggested by (a). 


(a) If g(xo) 4 0 and g™ (xo) exists, then the reciprocal h = 1/g is also n times 
differentiable at xo, by Exercise 2.5.11(a), with f(x) = 1/x. Let G, and Hy, 
be the nth Taylor polynomials of g and h about x9. Use Exercise 2.5.11(a) to 
prove that if g(xo) = 1, then H;, can be obtained by expanding the polynomial 


S> [l= Ga(x)]” 
r=1 


in powers of x — Xo and retaining only powers through the nth. 
(b) Use the method of (a) to compute the first four derivatives of the following 
functions at xo. 
(i) h(x) =csex, x9 = 2/2 
(ii) hw) =(+x+x7)1, x0 =0 
(iii) A(x) =secx, xo = 7/4 
(iv) h(x) =[1+log(1+x)]J7', x0 =0 
(c) Use Exercise 2.5.10 to justify the following alternative procedure for obtaining 
HA, again assuming that g(xo) = 1: If 


Gn(x) = 1 +41 (x — x9) + +++ + an (x — x0)” 
(where, of course, ay = g%(xo)/r!) and 
Hy (x) = bo + by (x — X09) + +++ + bn(x — x0)", 
then 
k 


bo =1, de =— Yo arby-p, 1 Sk <n. 


r=1 


Determine whether xo = 0 is a local maximum, local minimum, or neither. 


aipmare (b) f(x) = x3e" 
sae 1+x? 
(70) = 7s (d) f@) = 3 
(e) f(x) = x? sin? x + x? cos x (f) f(x) = e* sinx 
(g) f(x) = e* sin x? (h) f(x) = e* cos x 


Give an example of a function that has zero derivatives of all orders at a local mini- 
mum point. 


15. 


16. 


17. 


18. 


In Exercises 2.5.19-2.5.22, A is the forward difference operator with spacing h > 0. 
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Find the critical points of 


3 2 
foe t+ texta 


and identify them as local maxima, local minima, or neither. 
Find an upper bound for the magnitude of the error in the approximation. 


1 
(a) sinx ex, |x|<— 


20 
(b) VJIl+x21+4+ 


1 
Ix] <5 

8 
a ee 
Zl-@-) F<5<8 
(x-1) (x-1) 1 


(d) al) al ee ae ae Ix -—1]< — 


Xx 
2’ 


(c) cosx ® 


Prove: If 


a r 


T(x) = =, 


r=0 


then 


xntl —1 
Ty (X) < Thi (x) < e* < 1 a | T(x) 


if0<x<[(n+t1I)y/Or, 


The forward difference operators with spacing h > 0 are defined by 


A® f(x) = f(x), ASX) = fe +h) — f(x), 


A+! f(x) = A[A"f(Q)], n= 1. 


111 


(a) Prove by induction on n: If k > 2,¢1,..., cg are constants, andn > 1, then 


A" [er fi(x) +++ + cK fe (X)] = cr A” fix) +++ + KA” fx (x). 


(b) Prove by induction: If n > 1, then 


A* f(x) = oC (") f(x + mh). 
m=0 


HINT: See Exercise 1.2.19. 
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19. 


20. 


21. 


22. 


23. 


24. 


Let m and n be nonnegative integers, and let x9 be any real number. Prove by 
induction on n that 


0 if O<m<n, 


n _ m _ 
ls at nih” if m=n. 


Does this suggest an analogy between “differencing” and differentiation? 
Find an upper bound for the magnitude of the error in the approximation 
A* f (xo — h) 

f' (x0) © 3-4 


(a) assuming that f’” is bounded on (xo —h, xo +h); 
(b) assuming that f“ is bounded on (xo —h, xo + A). 


Let f’” be bounded on an open interval containing x9 and xo + 2h. Find a constant 
k such that the magnitude of the error in the approximation 


2. 
Pye AL) En ~A Leo) 


is not greater than Mh, where M = sup {| f””(c)| | |xo <c < Xo}. 


Prove: If f+ is bounded on an open interval containing x9 and x9 + nh, then 


A” 
ae) — f (xo)| < AnMn4ih, 


where A, is a constant independent of f and 


Mai= sup ([f?*PO). 


xo<c<xo+nh 


HINT: See Exercises 2.5.18 and 2.5.19. 


Suppose that gery) exists on (a,b), Xo, ..., Xn are in (a,b), and p is the polyno- 
mial of degree < n such that p(x;) = f(x;),0 <i <n. Prove: If x € (a,b), 
then Pee, 

f(x) = p(x) + i oe — Xo)(X — x1)-+-(% — Xn), 


(n+)! 


where c, which depends on x, is in (a,b). HINT: Let x be fixed, distinct from xo, 
X1,-.-, Xn, and consider the function 


g(y) = fO) — PO) - (y — xo0)(y — x1) +++ (¥ — Xn), 


K 
(+1)! 


where K is chosen so that g(x) = 0. Use Rolle’s theorem to show that K = 
f@*) (ec) for some c in (a,b). 


Deduce Theorem 2.5.4 from Theorem 2.5.5. 


CHAPTER 3 


Integral Calculus of 
Functions of One Variable 


IN THIS CHAPTER we discuss the Riemann integral of a bounded function on a finite 
interval [a, b], and improper integrals in which either the function or the interval of inte- 
gration is unbounded. 


SECTION 3.1 begins with the definition of the Riemann integral and presents the geo- 
metrical interpretation of the Riemann integral as the area under a curve. We show that 
an unbounded function cannot be Riemann integrable. Then we define upper and lower 
sums and upper and lower integrals of a bounded function. The section concludes with the 
definition of the Riemann-Stieltjes integral. 


SECTION 3.2 presents necessary and sufficient conditions for the existence of the Riemann 
integral in terms of upper and lower sums and upper and lower integrals. We show that 
continuous functions and bounded monotonic functions are Riemann integrable. 


SECTION 3.3 begins with proofs that the sum and product of Riemann integrable functions 
are integrable, and that | f| is Riemann integrable if f is Riemann integrable. Other topics 
covered include the first mean value theorem for integrals, antiderivatives, the fundamental 
theorem of calculus, change of variables, integration by parts, and the second mean value 
theorem for integrals. 


SECTION 3.4 presents a comprehensive discussion of improper integrals. Concepts de- 
fined and considered include absolute and conditional convergence of an improper integral, 
Dirichlet’s test, and change of variable in an improper integral. 


SECTION 3.5 defines the notion of a set with Lebesgue measure zero, and presents a 
necessary and sufficient condition for a bounded function f to be Riemann integrable on 
an interval [a, b]; namely, that the discontinuities of f form a set with Lebesgue masure 
zero. 


3.1 DEFINITION OF THE INTEGRAL 


The integral that you studied in calculus is the Riemann integral, named after the German 
mathematician Bernhard Riemann, who pie a rigorous formulation of the integral to 
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replace the intuitive notion due to Newton and Leibniz. Since Riemann’s time, other kinds 
of integrals have been defined and studied; however, they are all generalizations of the 
Riemann integral, and it is hardly possible to understand them or appreciate the reasons for 
developing them without a thorough understanding of the Riemann integral. In this section 
we deal with functions defined on a finite interval [a,b]. A partition of [a, b] is a set of 
subintervals 


[xo, Xi], [%1, X2],---, [Xn—-1, Xn], (3.1.1) 
where 


A=X9 <Xy0 < xX, =D. (3.1.2) 


Thus, any set of m + 1 points satisfying (3.1.2) defines a partition P of [a,b], which we 


denote by 
P= {x0, X1, weg tn} 


The points x9, X1, ..., X, are the partition points of P. The largest of the lengths of the 
subintervals (3.1.1) is the norm of P, written as || P ||; thus, 


||P || = max (x; — x;-1). 
1<i<n 
If P and P’ are partitions of [a, b], then P’ is a refinement of P if every partition point 


of P is also a partition point of P’; that is, if P’ is obtained by inserting additional points 
between those of P. If f is defined on [a, b], then a sum 


o => f(cj)(xj — xj-1), 


J=1 
where 
Xj Sc; Sxj, IS jn, 
is a Riemann sum of f over the partition P = {xo,X1,...,Xn}. (Occasionally we will say 


more simply that o is a Riemann sum of f over [a, b].) Since c; can be chosen arbitrarily 
in [x;,x;—-1], there are infinitely many Riemann sums for a given function f over a given 
partition P. 


Definition 3.1.1 Let f be defined on [a,b]. We say that f is Riemann integrable on 
[a, b] if there is a number L with the following property: For every € > 0, there isad > 0 
such that 

la-—L| <e 


if o is any Riemann sum of f over a partition P of [a, b] such that || P || < 6. In this case, 
we say that L is the Riemann integral of f over |a, b], and write 


[soa =L. 
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F F b Baie Hoey aus : 
We leave it to you (Exercise 3.1.1) to show that ‘ps F(x) dx is unique, if it exists; that is, 
there cannot be more than one number L that satisfies Definition 3.1.1. 
For brevity we will say “integrable” and “integral” when we mean “Riemann integrable” 
and “Riemann integral.” Saying that by f(x) dx exists is equivalent to saying that f is 


integrable on [a, D]. 
Example 3.1.1 If 
f(x)=1, a<x<b, 
then 
n n 

> FENG — xia) = } Gy = a). 

j=l j=) 
Most of the terms in the sum on the right cancel in pairs; that is, 


n 
» Gi =%j=-1) = G1 = x0) + Go = a1) +++ Gee = Xn 1) 
j=1 
= —Xo + (X41 — 1) + (X2 — X2) Hee + Xn-1 — Xn—-1) + Xn 
= Xn — X0 


=b-a. 


Thus, every Riemann sum of f over any partition of [a, b] equals b — a, so 


b 
/ dx =b-—-a. 


Example 3.1.2 Riemann sums for the function 
f(x)=x, asx<b, 


are of the form 


n 
o =) ej(xj —xj-1). (3.1.3) 
j=l 
Since xj-1 < cj; < x; and (x; + x;~1)/2 is the midpoint of [x ;—1, x;], we can write 
Xj +xX;E 
ga ~ i + dj, (3.1.4) 
where i] 
Xj —Xj-1 
| a pas 2 = 5 ( ) 


Substituting (3.1.4) into (3.1.3) yields 


n n 
Xj; +Xj-1 
o= > xy Sap dj (xj — xj-1) 


vo) a (3.1.6) 


1 n 
— 5 (x7 _ m4) + a dj (x; —Xj-1). 
J=1 j=l 
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Because of cancellations like those in Example 3.1.1, 


so (3.1.6) can be rewritten as 


b2 — a2 n 
o= ) +) dj(ej -xj-1). 
j=l 
Hence, 
b* — a? Z Pil — 
aes < > |d;|\(xj; —xj-1) < cal be: —xj-1) (see (3.1.5)) 
j=1 J=1 
P 
= leo, 


Therefore, every Riemann sum of f over a partition P of [a, b] satisfies 


2€ 
b— 


b? — a? 


<e if ||P|_<6= 


b ae) 
[ xav=7 = 
3 2: 


The Integral as the Area Under a Curve 


Hence, 


An important application of the integral, indeed, the one invariably used to motivate its 
definition, is the computation of the area bounded by a curve y = f(x), the x-axis, and 
the lines x = a and x = b (“the area under the curve”), as in Figure 3.1.1. 


y 


Figure 3.1.1 
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For simplicity, suppose that f(x) > 0. Then f(c;)(x; — xj;—1) is the area of a rectangle 
with base x; — x;—1 and height f(c;), so the Riemann sum 


> f(cs)(xj — xj-1) 


jJ=1 


can be interpreted as the sum of the areas of rectangles related to the curve y = f(x), as 
shown in Figure 3.1.2. 


>< 


y=fQ) 


Figure 3.1.2 


An apparently plausible argument, that the Riemann sums approximate the area under 
the curve more and more closely as the number of rectangles increases and the largest of 
their widths is made smaller, seems to support the assertion that i f(x) dx equals the 
area under the curve. This argument is useful as a motivation for Definition 3.1.1, which 
without it would seem mysterious. Nevertheless, the logic is incorrect, since it is based 
on the assumption that the area under the curve has been previously defined in some other 
way. Although this is true for certain curves such as, for example, those consisting of line 
segments or circular arcs, it is not true in general. In fact, the area under a more complicated 
curve is defined to be equal to the integral, if the integral exists. That this new definition is 
consistent with the old one, where the latter applies, is evidence that the integral provides 
a useful generalization of the definition of area. 


Example 3.1.3 Let f(x) =x, 1 <x <2 (Figure 3.1.3, page 118). The region under 


the curve consists of a square of unit area, surmounted by a triangle of area 1/2; thus, the 
area of the region is 3/2. From Example 3.1.2, 


2 1 3 
= ~—(27-17) = 
[xa 5 =F 


so the integral equals the area under the curve. 
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Figure 3.1.3 


Figure 3.1.4 


Example 3.1.4 If 
fQ@)=x?, 1<x<2 


(Figure 3.1.4), then 


= ae ge 


(Exercise 3.1.4), so we say that the area under the curve is 7/3. However, this is the defini- 
tion of the area rather than a confirmation of a previously known fact, as in Example 3.1.3. 
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Theorem 3.1.2 /f f is unbounded on [a,b], then f is not integrable on [a,b]. 


Proof We will show that if f is unbounded on [a,b], P is any partition of [a,b], and 
M > 0, then there are Riemann sums o and o’ of f over P such that 


lo —o'|>M. (3.1.7) 


We leave it to you (Exercise 3.1.2) to complete the proof by showing from this that f 
cannot satisfy Definition 3.1.1. 


Let , 
a= >) fyi — j-1) 
j=l 


be a Riemann sum of f over a partition P of [a,b]. There must be an integer i in 
{1,2,...,m} such that 


M 
fey= 7) = ——__— (3.1.8) 
Xj — Xj-1 
for some c in [x;—1x;], because if there were not so, we would have 
M ; 
f= fen <——7) 2 Seetseye Ley sn, 
Xj —Xj-1 


Then 


IFC = [Fen + FO) — Fea s Ifa + IFC) - fen 


M 
2 \fen)l+——— 44 Se sx LS jen. 
Xj —Xj-1 


which implies that 
M 
[f@)| < max |f(cj)| + ———, a<x<b, 
l<j<n Xj —Xj-1 


contradicting the assumption that f is unbounded on [a, 5]. 


Now suppose that c satisfies (3.1.8), and consider the Riemann sum 


o = > f(cj)(xj — xj-1) 


j=l 


over the same partition P, where 
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Since 
lo —o'| = |f(e) — fei) |@i — xi-1), 
(3.1.8) implies (3.1.7). 0 


Upper and Lower Integrals 


Because of Theorem 3.1.2, we consider only bounded functions throughout the rest of this 
section. 


To prove directly from Definition 3.1.1 that i F(x) dx exists, it is necessary to discover 
its value L in one way or another and to show that L has the properties required by the 
definition. For a specific function it may happen that this can be done by straightforward 
calculation, as in Examples 3.1.1 and 3.1.2. However, this is not so if the objective is to find 
general conditions which imply that // ? J (x) dx exists. The following approach avoids the 
difficulty of having to discover L in advance, without knowing whether it exists in the first 
place, and requires only that we compare two numbers that must exist if f is bounded on 


[a, b]. We will see that // 4 Ff (x) dx exists if and only if these two numbers are equal. 


Definition 3.1.3 If f is bounded on [a,b] and P = {xo,X1,...,Xn} is a partition of 
[a, b], let 


M;= sup F(x) 
Xj-1 SXSX; 
and 
mj= inf f(x). 


Xj7—1SXSX;7 


The upper sum of f over P is 


S(P) = D0 Mj (xj — xj-1). 


j=l 


and the upper integral of f over, [a,b], denoted by 


[reves 


is the infimum of all upper sums. The lower sum of f over P is 
n 
s(P) = > mj (x; = Xj-1); 
j=l 
and the lower integral of f over [a, b], denoted by 


i ” po ax, 


is the supremum of all lower sums. | 
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Ifm < f(x) < M for all x in [a, 5], then 

m(b —a) < s(P) < S(P) < Mb —a) 
for every partition P; thus, the set of upper sums of f over all partitions P of [a, b] is 
bounded, as is the set of lower sums. Therefore, Theorems 1.1.3 and 1.1.8 imply that 
i ? f(x) dx and f y F(x) dx exist, are unique, and satisfy the inequalities 

“Ab 
m(b—a) < [ f(x)dx < Mba) 
a 

and 


b 
m(b — a) < | f(x) dx < M(b—a). 


Theorem 3.1.4 Let f be bounded on [a,b], and let P be a partition of [a,b]. Then 


(a) The upper sum S(P) of f over P is the supremum of the set of all Riemann sums of 
f over P. 


(b) The lower sum s(P) of f over P is the infimum of the set of all Riemann sums of f 
over P. 


Proof (a) If P = {xo,x1,...,Xn}, then 


S(P) = D5 Mj (x; — xj-1), 


j=1 
where 
M;= sup f(x). 


Xj—1SXSX;7 


An arbitrary Riemann sum of f over P is of the form 


n 
o => f(cj(xj —xj-1), 
j=3 
where x;-1 <cj; < x;. Since f(c;) < M,;, it follows that o < S(P). 
Now let € > 0 and choose ¢; in [x;-1, x;] so that 


€ 


el a ara Ls pan 
The Riemann sum produced in this way is 
n n 
T= >° FEN; — 2-1) > DO [M, - ao) (xj —xj-1) = S(P)-e. 
j=1 = n(x; — xj-1) 


Now Theorem 1.1.3 implies that S(P) is the supremum of the set of Riemann sums of f 
over P. 


(b) Exercise 3.1.7. a 
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Example 3.1.5 Let 


7S 0 if x is irrational, 
~ (1 if x is rational, 
and P = {xo,X1,...,Xn} bea partition of [a, b]. Since every interval contains both ratio- 


nal and irrational numbers (Theorems 1.1.6 and 1.1.7), 
m;=0O and M;=1, 1sj <n. 
Hence, 
n 
S(P) = )01-(%j —xj-1) =b-a 
j=l 
and 
n 
s(P) = )°0-(@j —xj-1) = 0. 
j=l 


Since all upper sums equal b — a and all lower sums equal 0, Definition 3.1.3 implies that 
“pb b 
/ F(x)dx =b-a_ and / F(x) dx = 0. 
a a 


Example 3.1.6 Let f be defined on [1,2] by f(x) = Oif x is irrational and f(p/q) = 
1/q if p and q are positive integers with no common factors (Exercise 2.2.7). If P = 


{X0,X1,...,Xn} is any partition of [1, 2], thenm,; = 0,1 < j <n,sos(P) = 0; hence, 
2 
/ F(x) dx =0. 
1 
We now show that ae 
2 
/ F(x) dx =0 (3.1.9) 
1 
also. Since $(P) > 0 for every P, Definition 3.1.3 implies that 
2 
/ fla) dx > 0, 
1 
so we need only show that _ 
2 
/ F(x) dx <0, 
1 


which will follow if we show that no positive number is less than every upper sum. To this 
end, we observe that if 0 < « < 2, then f(x) > €/2 for only finitely many values of x in 
[1, 2]. 

Let k be the number of such points and let Po be a partition of [1, 2] such that 


€ 
Poll < —. i 
I| Poll < 5 (3.1.10) 
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Consider the upper sum 


n 
S(Po) = >| Mj (xj — xj-1). 
j=l 
There are at most k values of j in this sum for which M; > €/2, and M; < 1 even for 
these. The contribution of these terms to the sum is less than k(€/2k) = €/2, because of 
(3.1.10). Since M; < €/2 for all other values of j, the sum of the other terms is less than 


n 
€ € € € 
= Pee —XxXj-1) = =(Xn — Xo) = -(2 = 1) =. 
2 a 2 2 2 
Therefore, S(Po) < € and, since € can be chosen as small as we wish, no positive number 
is less than all upper sums. This proves (3.1.9). | 


The motivation for Definition 3.1.3 can be seen by again considering the idea of area 
under a curve. Figure 3.1.5 shows the graph of a positive function y = f(x),a <x <b, 
with [a, b] partitioned into four subintervals. 


y 


Figure 3.1.5 


The upper and lower sums of f over this partition can be interpreted as the sums of the areas 
of the rectangles surmounted by the solid and dashed lines, respectively. This indicates that 
a sensible definition of area A under the curve must admit the inequalities 


s(P) <A<S(P) 


for every partition P of [a,b]. Thus, A must be an upper bound for all lower sums and a 
lower bound for all upper sums of f over partitions of [a, b]. If 


“Tb b 
[ teax=f f@) ds, (3.1.41) 
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there is only one number, the common value of the upper and lower integrals, with this 
property, and we define A to be that number; if (3.1.11) does not hold, then A is not defined. 
We will see below that this definition of area is consistent with the definition stated earlier 
in terms of Riemann sums. 


Example 3.1.7 Returning to Example 3.1.3, consider the function 
f(x)=x, <x <2. 
If P = {xo, X1,..., Xn} is a partition of [1, 2], then, since f is increasing, 


Mj = f(xj)=xj and mj = f(xj-1) = Xj-1. 


Hence, 
n 
S(P) = D0 xj —xj-1) (3.1.12) 
j=1 
and 
n 
iP) = 9° xp —zj21): (3.1.13) 
j=l 
By writing 
Xj +Xj-1 Xj —Xj-1 
of ae a 
we see from (3.1.12) that 
1x 2 2 lx 2 
S(P) = 5 D5 — 9-1) + 5 DG - 41) 
a e. (3.1.14) 


1 1 
= 52° eg a > Gy — xy)? 
j=l 


Since , , 
0< So (xj —xj-1)? < IPI Gj —xj-1) = PIA, 
j=l j=l 
(3.1.14) implies that 


3 spy <3 WL 


Since || P || can be made as small as we please, See 3.1.3 implies that 


f? 3 
i f(x)dx = 5 


A similar argument starting from (3.1.13) shows that 
3 (Pll 5. 


27g =8)< 
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so 
3 
dx=-. 
[ fous; 
Since the upper and lower integrals both equal 3/2, the area under the curve is 3/2 accord- 
ing to our new definition. This is consistent with the result in Example 3.1.3. 


The Riemann-Stieltjes Integral 


The Riemann-—Stieltjes integral is an important generalization of the Riemann integral. We 
define it here, but confine our study of it to the exercises in this and other sections of this 
chapter. 


Definition 3.1.5 Let f and g be defined on [a, b]. We say that f is Riemann-Stieltjes 
integrable with respect to g on |a, b] if there is a number L with the following property: 
For every € > 0, there is a 6 > O such that 


n 
> fei) [g@s) — g@j-1)] - L] <«., (3.1.15) 
j=l 
provided only that P = {xo,x1,..., Xn} is a partition of [a, b] such that || P || < 6 and 
Xj ScjSxj, jf =1,2,...,n. 


In this case, we say that L is the Riemann-Stieltjes integral of f with respect to g over 
[a, b], and write 


b 
/ f(x) dg(x) = L. 
The sum ‘ 
d fei) [ge - ¢@j-1)] 
j=l 


in (3.1.15) is a Riemann-Stieltjes sum of f with respect to g over the partition P.. 


3.1 Exercises 


1. Show that there cannot be more than one number L that satisfies Definition 3.1.1. 


2. (a) Prove: If fe F(x) dx exists, then for every € > 0, there is a 5 > O such that 
|o1 — 02| < € if o, and o2 are Riemann sums of f over partitions P; and P2 
of [a, b] with norms less than 6. 
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(b) Suppose that there isan M > 0 such that, for every 5 > 0, there are Riemann 
sums 0, and 02 over a partition P of [a, b] with || P || < 6 such that |o, —o2| > 
M. Use (a) to prove that f is not integrable over [a, b]. 


3. Suppose that / i f(x) dx exists and there is a number A such that, for every « > 0 
and 6 > 0, there is a partition P of [a, b] with ||P || < 6 and a Riemann sum o of f 


over P that satisfies the inequality |a — A| < ¢. Show that rh F(x) dx =A. 


4. Prove directly from Definition 3.1.1 that 


b 3. 83 
[ ear? aim 
Ys 3 


Do not assume in advance that the integral exists. The proof of this is part of the 
problem. HINT: Let P = {xX0,X2,...,Xn} be an arbitrary partition of [a,b]. Use 
the mean value theorem to show that 


b3 — a3 


si >| d? (xj — xj-1) 
j=l 


for some points d,, ..., dn, where xj-1 < dj < xj. Then relate this sum to 
arbitrary Riemann sums for f(x) = x? over P. 


5. Generalize the proof of Exercise 3.1.4 to show directly from Definition 3.1.1 that 


b pmrt —qmrl 
/ x” ax = ———__—_ 
- m+1 


if m is an integer > 0. 


6. Prove directly from Definition 3.1.1 that f(x) is integrable on [a, b] if and only if 
J (—*) is integrable on [—b, —a], and, in this case, 


b —a 
[ foax = , I (—x) dx. 


7. Let f be bounded on [a, b] and let P be a partition of [a, b]. Prove: The lower sum 
S(P) of f over P is the infimum of the set of all Riemann sums of f over P. 
8. Let f be defined on [a, b] and let P = {xo0, X1,...,Xn} be a partition of [a, 5]. 


(a) Prove: If f is continuous on [a, b], then s(P) and S(P) are Riemann sums of 
f over P. 

(b) Name another class of functions for which the conclusion of (a) is valid. 

(c) Give an example where s(P) and S(P) are not Riemann sums of f over P. 


10. 


11. 


12. 


13. 


14. 


15. 


16. 
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Find Jo f@) dx and fi FO) dx if 


x if x is rational, 1 if x is rational, 
(a) fO) = —x if x is irrational. (b) f(x) = x if x is irrational. 
Given that ia e* dx exists, evaluate it by using the formula 
t= pti 
ltrtrete tra jaa 
—r 


to calculate certain Riemann sums. HINT: See Exercise 3.1.3. 


Given that ih sinx dx exists, evaluate it by using the identity 
cos(j — 1)@ —cos(j + 1)0 = 2sin@ sin j0 


to calculate certain Riemann sums. HINT: See Exercise 3.1.3. 


Given that hy cos x dx exists, evaluate it by using the identity 
sin(j + 1)@ —sin(j — 1)@ = 2sin@ cos j0 


to calculate certain Riemann sums. HINT: See Exercise 3.1.3. 
Show that if g(x) = x + c (c=constant), then im F(x) dg(x) exists if and only if 
Ec Ff (x) dx exists, in which case 


/ FOaws= / " Pose 


Suppose that —-oo <a <d <c < cand 


a<x<d, 
b (gi, 2 = constants), 


_ gi. 

g(x) = ts d<x< 

and let g(a), g(b), and g(d) be arbitrary. Suppose that f is defined on [a, 5], 

continuous from the right at a and from the left at b, and continuous at d. Show that 
es Ff (x) dg(x) exists, and find its value. 


Suppose that -co < a = dg < aj < ++: < dp = b < w, let g(x) = gm 
(constant) on (@m—1,4m), 1 <m < p, and let g(a), g(a1), ..., g(ap) be arbitrary. 
Suppose that f is defined on [a,b], continuous from the right at a and from the 
left at b, and continuous at a1, dz, ..., dp—1. Evaluate _ F(x) dg(x). HINT: See 
Exercise 3.1.14. 


(a) Give an example where /[ : F(x) dg(x) exists even though f is unbounded 
on [a, b]. (Thus, the analog of Theorem 3.1.2 does not hold for the Riemann— 
Stieltjes integral.) 

(b) State and prove an analog of Theorem 3.1.2 for the case where g is increasing. 
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17. For the case where g is nondecreasing and f is bounded on [a, b], define upper and 
lower Riemann-Stieltjes integrals in a way analogous to Definition 3.1.3. 


3.2 EXISTENCE OF THE INTEGRAL 


The following lemma is the starting point for our study of the integrability of a bounded 
function f on a closed interval [a, b]. 


Lemma 3.2.1 Suppose that 


If@)| <M, asx<b, (3.2.1) 
and let P’ be a partition of |a, b| obtained by adding r points to a partition P = {xo,X1,...,Xn} 
of [a, b]. Then 

S(P) => S(P’) = S(P) —2Mr||P || (3.2.2) 
and 
s(P) <s(P’) <s(P)+2Mr|P|. (3.2.3) 


Proof We will prove (3.2.2) and leave the proof of (3.2.3) to you (Exercise 3.2.1). 
First suppose that r = 1, so P’ is obtained by adding one point c to the partition P = 
{x0,X1,...,Xn}; then x;-1 < c < x; for some i in {1,2,...,n}. If 7 # i, the prod- 
uct M;(x; — x;-1) appears in both S(P) and S(P’) and cancels out of the difference 
S(P) — S(P’). Therefore, if 


Mi = sup f(x) and Mi2= sup f(x), 


xXj_1<x<e C<x<x; 
then 

SP) = SP) = Mii — aes) = Mile =a) = Mal — ©) 

= (Mj — Mii)(c — xi-1) + (Mi — Mi2)(xi — ¢). 


(3.2.4) 


Since (3.2.1) implies that 
0<M,-—Mi,<2M, r=1,2, 
(3.2.4) implies that 
0 < S(P) — S(P’) < 2M(x; — xj-1) < 2M ||P ||. 


This proves (3.2.2) forr = 1. 


Now suppose that r > 1 and P’ is obtained by adding points c1, cz, ..., cy to P. Let 
P© = P and, for j > 1, let PY be the partition of [a,b] obtained by adding c; to 
P&-Y). Then the result just proved implies that 


0< S(PU-))—s(PY) <2m||PE-Y], 1<j <r. 
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Adding these inequalities and taking account of cancellations yields 
0< S(P)— S(P) < 2M(IPO| + [POL + POPP. 2.5) 


Since PO = P, P™ = P’, and ||P || < || P&-)|| for 1 < k <r —1, (3.2.5) implies 
that 
0 < S(P) — S(P") < 2Mr||PI, 


which is equivalent to (3.2.2). an] 


Theorem 3.2.2 If f is bounded on [a,b], then 


b “pb 
/ F(x) dx <| F(x) dx. (3.2.6) 
Ja_ a 
Proof Suppose that P; and Py, are partitions of [a,b] and P’ is a refinement of both. 
Letting P = P, in (3.2.3) and P = P) in (3.2.2) shows that 
s(P1) <s(P’) and S(P’) < S(P3). 


Since s(P’) < S(P’), this implies that s(P,;) < S(P2). Thus, every lower sum is a lower 


bound for the set of all upper sums. Since / 7 F(x) dx is the infimum of this set, it follows 
that 


Ab 
s(P\) < / fx) dx 


for every partition P, of [a,b]. This means that is F(x) dx is an upper bound for the set 
of all lower sums. Since PI@) dx is the supremum of this set, this implies (3.2.6). 


Theorem 3.2.3 /f f is integrable on [a,b], then 


“fas =f 26 = ” gexdde. 
[ food= [sear | 


Proof We prove that f? f(x) dx = - J (x) dx and leave it to you to show that ? f(x) dx = 


(i J (x) dx (Exercise 3.2.2). 


Suppose that P is a partition of [a,b] and o is a Riemann sum of f over P. Since 


“Ab b Ab 
y fe) dx — / rovax=(f fisyax SP) + (8(P)—2) 


b 
(of risyas). 
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the triangle inequality implies that 


Ab b Ab 
[ teoa-f f(x)dx| < / F(x) dx — S(P)| + |S(P) —o| 


(3.2.7) 
+ 


o—f sayay 


Now suppose that « > 0. From Definition 3.1.3, there is a partition Po of [a, b] such that 


ah oa : 
i f(x) dx < S(Pp) < / fx)dx + 5. (3.2.8) 


From Definition 3.1.1, there is a 6 > 0 such that 


? € 
of F(x) dx| < 3 (3.2.9) 


if || P || < 5. Now suppose that || P || < 6 and P is arefinement of Po. Since S(P) < S(Po) 
by Lemma 3.2.1, (3.2.8) implies that 


ae ae 
/ f(x) dx < S(P) < / f(x) dx + _ 
sO 


Ab 
S(P) -{ f(x) dx 


€ 
<s 3.2.10 
3 ( ) 


in addition to (3.2.9). Now (3.2.7), (3.2.9), and (3.2.10) imply that 


ir ” ex) dx 
| ey, 


for every Riemann sum o of f over P. Since S(P) is the supremum of these Riemann 
sums (Theorem 3.1.4), we may choose o so that 


2 
< = +|S(P)—o| (3.2.11) 


€ 
P)- = 
IS(P) -9| <5 


Now (3.2.11) implies that 
<€,. 


[reas a f(x) dx 


Since € is an arbitrary positive number, it follows that 


T (eae ” Fe)dx. q 
[ foare f 
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Lemma 3.2.4 If f is bounded on [a, b| and « > 0, there is a5 > 0 such that 


“pb ab 

/ f(x)dx < S(P) <| tjdese (3.2.12) 
and ; ; 

/ fade > s(P)> f f(x) dx -€ 
if ||P || < 6. 


Proof We show that (3.2.12) holds if || P || is sufficiently small, and leave the rest of the 
proof to you (Exercise 3.2.3). 


The first inequality in (3.2.12) follows immediately from Definition 3.1.3. To establish 
the second inequality, suppose that | f(x)| < K ifa <x <b. From Definition 3.1.3, there 
is a partition Pp = {x0, X1,...,Xr41} of [a, b] such that 


=i 
S(Po) ey]: f(x)dx + _ (3.2.13) 


If P is any partition of [a, b], let P’ be constructed from the partition points of Po and P. 
Then 
S(P') < S(Po). (3.2.14) 


by Lemma 3.2.1. Since P’ is obtained by adding at most r points to P, Lemma 3.2.1 
implies that 
S(P’) = S(P) —2Kr||P|. G.2.15) 


Now (3.2.13), (3.2.14), and (3.2.15) imply that 


S(P) < S(P') +2Kr||P| 
< S(Po) + 2Kr||P|| 


b 
Z / f@xydx+ : 4+2Kr|| Pl. 


Therefore, (3.2.12) holds if 


€ 
P| <6 = —. 
IPI<8= 7 D 


Theorem 3.2.5 If f is bounded on [a, b| and 


b “Ab 
i) f(x) dx =} fOojax=1, (3.2.16) 


then f is integrable on |a,b| and 


b 
/ f(x)dx = L. (3.2.17) 
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Proof Ife > 0, there is ad > 0 such that 


b “pb 
/ fix)dx—e <s(P) 3 5(P) < f f(x)dx +¢€ (3.2.18) 
Ja_ a 
if || P || < 6 (Lemma 3.2.4). If o is a Riemann sum of f over P, then 
s(P) <a <S(P), 
so (3.2.16) and (3.2.18) imply that 
L—-e<o<L+e 


if || P || < 6. Now Definition 3.1.1 implies (3.2.17). q 
Theorems 3.2.3 and 3.2.5 imply the following theorem. 


Theorem 3.2.6 A bounded function f is integrable on [a, b] if and only if 


[roa =f pooas. 


The next theorem translates this into a test that can be conveniently applied. 


Theorem 3.2.7 /f f is bounded on [a,b], then f is integrable on [{a, b] if and only if 
for each € > 0 there is a partition P of |a, b| for which 


S(P) —s(P) <e. (3.2.19) 


Proof We leave it to you (Exercise 3.2.4) to show that if sg F(x) dx exists, then (3.2.19) 
holds for || P || sufficiently small. This implies that the stated condition is necessary for in- 
tegrability. To show that it is sufficient, we observe that since 


b “hb 
Py sf fx) dx <|/ f(x) dx < S(P) 


for all P, (3.2.19) implies that 
“pb b 
O0< / f(x) dx -{ F(x) dx <e. 
a Ja 
Since € can be any positive number, this implies that 
“pb b 
i f(x) dx = ; F(x) dx. 
a Ja 


Therefore, ie F(x) dx exists, by Theorem 3.2.5. q 


The next two theorems are important applications of Theorem 3.2.7. 
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Theorem 3.2.8 /f f is continuous on [a,b], then f is integrable on [a,b]. 


Proof Let P = {xo, x1,..., Xn} bea partition of [a, b]. Since f is continuous on [a, D], 
there are points c; and c’, in [x;-1, xj] such that 


f(cj)=M; = sup f(x) 


Xj—|SXSX;7 


and 
fe) =mj=, inf £0) 
(Theorem 2.2.9). Therefore, 
S(P)—s(P) = >> [f(s) — FC] @j — xj-1). (3.2.20) 
j=1 


Since f is uniformly continuous on [a, b] (Theorem 2.2.12), there is foreach e > 0ad > 0 
such that 


If) — f@)| < -— 
—a 


if x and x’ are in [a, b] and |x —x'| < 6. If || P|] < 6, then |c; —c’,| < 6 and, from (3.2.20), 
€ n 
S(P) -s(P) < baa 2s ~xj-1) =€. 


Hence, f is integrable on [a, b], by Theorem 3.2.7. q 
Theorem 3.2.9 /f f is monotonic on [a,b], then f is integrable on [a, b}. 


Proof Let P = {xo,x1,..., Xn} be a partition of [a, b]. Since f is nondecreasing, 


f(xj)=M; = sup f(x) 


Xj—1SXSX;7 
and 


F(xj-1) =m; = eee F(x). 


Hence, 


S(P) — s(P) = DOF Gs) — F&@j-1)) ej — 2)-1). 
j=l 


Since 0 < x; —xj-1 < ||P|| and f(x;) — f(x;-1) = 9, 


S(P) -s(P) s IPI OU @) —- fj) 


j=l 


= PIC®) — f@). 
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Therefore, 
S(P)—s(P)<e if |PI(f)— f@) <e, 
so f is integrable on [a, b], by Theorem 3.2.7. 
The proof for nonincreasing f is similar. 0 
We will also use Theorem 3.2.7 in the next section to establish properties of the integral. 
In Section 3.5 we will study more general conditions for integrability. 


3.2 Exercises 


1. Complete the proof of Lemma 3.2.1 by verifying Eqn. (3.2.3). 
2. Show that if f is integrable on [a, b], then 


b b 
/ f(x)dx = 7 F(x) dx. 
Ja_ a 
3. Prove: If f is bounded on [a, b], there is for each e > 0 a6 > 0 such that 


b b 
[ fenaxe [ foyax-e <P) 


if ||P || <6. 
4. Prove: If f is integrable on [a,b] and e > 0, then S(P) — s(P) < « if ||P || is 
sufficiently small. HINT: Use Theorem 3.1.4. 


5. Suppose that f is integrable and g is bounded on [a, b], and g differs from f only 
at points in a set H with the following property: For each e > 0, H can be covered 
by a finite number of closed subintervals of [a, b], the sum of whose lengths is less 
than €. Show that g is integrable on [a, b] and that 


"ee dx = ” ¢x) dx. 
fewer f 


HINT: Use Exercise 3.1.3. 


6. Suppose that g is bounded on [a, 6], and let O : a = vp < vy <--- < ve = B be 
a fixed partition of [a, 6]. Prove: 


g =f “pB Lo, 
(a) fecdu= Sf onde (b) f/eenan=¥° f" een du 


7. A function f is of bounded variation on |a, b] if there is a number K such that 


Yl f@i)- f@-)| = K 


j=l 
whenever ad = dg < a1 <-+-+- < a, = b. (The smallest number with this property 
is the total variation of f on |a, b].) 


10. 
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(a) Prove: If f is of bounded variation on [a, b], then f is bounded on [a, 5]. 
(b) Prove: If f is of bounded variation on [a,b], then f is integrable on [a, 5]. 
HINT: Use Theorems 3.1.4 and 3.2.7. 


Let P = {xo0,%1,...,Xn} be a partition of [a,b], co = Xo = 4, Cn41 = Xn = D, 
and x;-1 <cj <xj;,j =1,2,...,n. Verify that 


Y> se )fO)-f@j-v1 = sh) fo)-g@fa@-Y~ f&lgcj+)-sc;)I. 


J=1 J=0 


Use this to prove that if iis F(x) dg(x) exists, then so does pe g(x) df (x), and 


b b 
[ scrape) = £06) - fagia - [feast 
(This is the integration by parts formula for Riemann-Stieltjes integrals.) 


Let f be continuous and g be of bounded variation (Exercise 3.2.7) on [a, b]. 


(a) Show that if « > 0, there is a 8 > 0 such that |o — o’| < ¢/2 if o and o’ 
are Riemann-Stieltjes sums of f with respect to g over partitions P and P’ 
of [a,b], where P’ is a refinement of P and ||P || < 6. HINT: Use Theo- 
rem 2.2.12. 


(b) Let 6 be as chosen in (a). Suppose that 0; and 02 are Riemann-Stieltjes 
sums of f with respect to g over any partitions P; and P2 of [a, b] with norm 
less than 6. Show that |o, — 02| < e. 


(c) If6 > 0, let L(6) be the supremum of all Riemann-Stieltjes sums of f with 
respect to g over partitions of [a, b] with norms less than 6. Show that L(6) is 
finite. Then show that L = lims_,94 L(6) exists. HINT: Use Theorem 2.1.9. 


(d) Show that rs f(x) dg(x) = L. 


Show that /' : F(x) dg(x) exists if f is of bounded variation and g is continuous on 
[a, b]. HINT: See Exercises 3.2.8 and 3.2.9. 


3.3 PROPERTIES OF THE INTEGRAL 


We now use the results of Sections 3.1 and 3.2 to establish the properties of the integral. 
You are probably familiar with most of these properties, but not with their proofs. 


Theorem 3.3.1 /f f and g are integrable on [a, b], then so is f + g, and 


[fu + g\(x)dx = [ fcdx + [sera 
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Proof Any Riemann sum of f + g over a partition P = {xo, X1,..., Xn} of [a, b] can 
be written as 


Ofte = [fF es) + ales xy - xj-1) 


j=l 


= 0 fs)Gy — xj-1) + DS (es) (j — xj-1) 
j=l j=l 
- > + Og, 


where of and og are Riemann sums for f and g. Definition 3.1.1 implies that if e > 0 
there are positive numbers 6; and 62 such that 


b 
oy - f f(x)dx <5 if Pll <5 


and 


b 
o- f g(x) dx <5 if ||Pl| < 60. 
a 


b b 
(or-f riya] + («| nas) 


If || P|] < 6 = min(61, 62), then 


b b 
orte— | fleddx— f atayax 


a 


b b 
s\or— sods] +|or- f eeras 
a a 
2 € i. € 
— -=€6, 
2 2 
so the conclusion follows from Definition 3.1.1. an 


The next theorem also follows from Definition 3.1.1 (Exercise 3.3.1). 


Theorem 3.3.2 If f is integrable on [a,b] and c is a constant, then cf is integrable 
on [a, b] and 


b b 
/ cf(x)dx = cf F(x) dx. 
a a 
Theorems 3.3.1 and 3.3.2 and induction yield the following result (Exercise 3.3.2). 


Theorem 3.3.3 /f fi, fo, ..., fn are integrable on [a,b] and cy, C2, ..., Cn are 
constants, then cy fi + C2 fo +-+:+¢n Sn is integrable on |a, b] and 


b b b 
[ Gfitahttenfyede =e f fils) dx ter f fo(x) dx 


b 
poten f Sn(x) dx. 
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Theorem 3.3.4 If f and g are integrable on [a,b] and f(x) < g(x) fora < x <b, 
then 


b b 
[ tera [ g(x) dx. (3.3.1) 


Proof Since g(x) — f(x) = 0, every lower sum of g — f over any partition of [a, b] is 
nonnegative. Therefore, 


b 
i; (g(x) — f(a) dx > 0. 
Hence, 7” 


b b b 
/ g(x) dx — / fx) dx = / (els) — f@) dx 
a a ms (3.3.2) 
a / (g(x) — f@) dx > 0, 


which yields (3.3.1). (The first equality in (3.3.2) follows from Theorems 3.3.1 and 3.3.2; 
the second, from Theorem 3.2.3.) 0 


Theorem 3.3.5 /f f is integrable on [a,b], then so is | f |, and 
b 
/ f(x) dx 


Proof Let P be a partition of [a, b] and define 


b 
</ | f(x)| dx. (3.3.3) 


M;=sop, {@) tp Se = 34}, 
mj = inf { f(x) | xj-1 =x SSote 
Mj; = sup {| f(x)| | xj-1 <x <x;}, 
mM; 


jy =inf {| f@)||xj-1 <x < x}. 


Then _ 
Mj —m; = sup {| f(x)| —|f(@)| |xj-1 Sx." Sx; 
< sup {| f(x) — f(®’)| | xj-1 <x, x! < x} (3.3.4) 
=M; —mj. 
Therefore, 


S(P) —S(P) < S(P) —s(P), 


where the upper and lower sums on the left are associated with | f| and those on the right are 
associated with f. Now suppose that € > 0. Since f is integrable on [a, b], Theorem 3.2.7 
implies that there is a partition P of [a,b] such that S(P) — s(P) < €. This inequality 
and (3.3.4) imply that S(P) — 5(P) < e. Therefore, | /| is integrable on [a,b], again by 
Theorem 3.2.7. 


Since 


F(x) <IF@)| and -—f@)s|f@)), asx <b, 
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Theorems 3.3.2 and 3.3.4 imply that 


b b b b 
[ fonaxs [ [feos ana - f foyax sf (feoiae. 
which implies (3.3.3). aa) 
Theorem 3.3.6 /f f and g are integrable on [a,b], then so is the product fg. 


Proof We consider the case where f and g are nonnegative, and leave the rest of the 
proof to you (Exercise 3.3.4). The subscripts f, g, and fg in the following argument 
identify the functions with which the various quantities are associated. We assume that 
neither f nor g is identically zero on [a, b], since the conclusion is obvious if one of them 
is. 


If P = {xo, X1,...,Xn} is a partition of [a, b], then 
n 
Spe(P) —S¢e(p) = Y\(Myg,j — mye; )(Xj — Xj-1)- (3.3.5) 
j=l 


Since f and g are nonnegative, Mfg; < My; Mg,; and mfg,; = mp jmg,;. Hence, 
Mfg,j —Mfe,j = MpjMe,j —myjme,; 
= (Mzj —mzj)Mg,j + myzj(Me,j —me,j) 
< Mg (Mp; —myzj) + Mp (Mg,j — mg, ;), 


where My and M, are upper bounds for f and g on [a,b]. From (3.3.5) and the last 
inequality, 


Sg(P) —Sfg(P) S Mg[Sp(P) —s¢(P)] + My[Sg(P) — sg (P)I. (3.3.6) 


Now suppose that e > 0. Theorem 3.2.7 implies that there are partitions P; and P2 of 
[a, b] such that 
€ 


: 3.3.7 
TF (3.3.7) 


€ 
S¢(P1) — sp¢(P1) < — _ and Sg(P2)— Sg(P2) < 
2M, 


If P is arefinement of both P; and Po, then (3.3.7) and Lemma 3.2.1 imply that 
€ 


€ 
S¢(P) —sp(P) < IM, and Sg(P)—S¢g(P) < 2M; 


This and (3.3.6) yield 


€ € 
Sfe(P) —Spe(P) <5 +5 =6. 


Therefore, fg is integrable on [a, b], by Theorem 3.2.7. q 


Section 3.3 Properties of the Integral 139 


Theorem 3.3.7 (First Mean Value Theorem for Integrals) Suppose that 
u is continuous and v is integrable and nonnegative on [a, b]. Then 


b b 
i u(x)v(x) dx = ue) | u(x) dx (3.3.8) 
for some c in [a, Bb]. 


Proof From Theorem 3.2.8, u is integrable on [a, b]. Therefore, Theorem 3.3.6 implies 
that the integral on the left exists. If = min {u(x) | a<x< b} and M = max {u(x) | a<x< b} 
(recall Theorem 2.2.9), then 

m<u(x) <M 


and, since v(x) > 0, 
mv(x) < u(x)u(x) < Mv(x). 


Therefore, Theorems 3.3.2 and 3.3.4 imply that 


b b b 
mf voydx = | u(x)v(x) dx <m f v(x) dx. (3.3.9) 


This implies that (3.3.8) holds for any c in [a,b] if [? v(x) dx = 0. If [? v(x) dx #0, 
let 


b 
/ u(x)vu(x) dx 
y= 4" (3.3.10) 


a v(x) dx 


Since ee v(x) dx > 0 in this case (why?), (3.3.9) implies that m < uw < M, and the 
intermediate value theorem (Theorem 2.2.10) implies that 7 = u(c) for some c in [a, b]. 
This implies (3.3.8). aa] 


If v(x) = 1, then (3.3.10) reduces to 


1 b 
v= al u(x) dx, 


so @ is the average of u(x) over [a, b]. More generally, if v is any nonnegative integrable 
function such that cia v(x) dx 4 0, then win (3.3.10) is the weighted average of u(x) over 
[a,b] with respect to v. Theorem 3.3.7 says that a continuous function assumes any such 
weighted average at some point in [a, 5]. 


Theorem 3.3.8 /f f is integrable on [a,b] anda < a, < by < b, then f is integrable 
on [a1, by]. 
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Proof Suppose that ¢ > 0. From Theorem 3.2.7, there is a partition P = {x9, X1,...,Xn} 
of [a, b] such that 


S(P) —s(P) = 9 \(Mj —mj)(xj — xj-1) <e. (3.3.11) 
j=l 


We may assume that a; and 5, are partition points of P, because if not they can be inserted 
to obtain a refinement P’ such that S(P’) — s(P’) < S(P) — s(P) (Lemma 3.2.1). Let 
a, = x, and by = xs. Since every term in (3.3.11) is nonnegative, 


s 
Ds (M; — mj )\(x; —Xj-1) <€. 
j=rt+l 


Thus, P = {x;,X;41,...,Xs} is a partition of [a,,b;] over which the upper and lower 
sums of f satisfy 7 _ 
S(P)—s(P) <e. 


Therefore, f is integrable on [a1, bi], by Theorem 3.2.7. q 


We leave the proof of the next theorem to you (Exercise 3.3.8). 


Theorem 3.3.9 /f f is integrable on [a,b] and [b,c], then f is integrable on [a,c], 
and 


c b c 
/ f(x)dx = / f(x) dx +f F(x) dx. (3.3.12) 
a a b 
So far we have defined Vi Ff (x) dx only for the case where a < B. Now we define 


[ feoas --[" f(x) dx 


ifa < B, and 
; F(x) dx = 0. 


With these conventions, (3.3.12) holds no matter what the relative order of a, b, and c, 
provided that f is integrable on some closed interval containing them (Exercise 3.3.9). 


Theorem 3.3.8 and these definitions enable us to define a function F(x) = f(t) dt, 
where c is an arbitrary, but fixed, point in [a, D]. 


Theorem 3.3.10 If f is integrable on [a,b] anda < c < b, then the function F 
defined by 


F(x) =), f(t) dt 


satisfies a Lipschitz condition on [a, b], and is therefore continuous on [a, b]. 
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Proof If x and x’ are in [a, 5], then 


Fa) - Fe’) = [ "fat — / "fat = i “fdr, 


by Theorem 3.3.9 and the conventions just adopted. Since | f(t)| < K (a < t <b) for 


some constant K, 
x 
[ toa 
x’ 


|F(x) — F@’)| s K|x-x'], asx, x’ <b. 


<K|x—-x'|, a<x,x'<b 


(Theorem 3.3.5), so 


aa 


Theorem 3.3.11 If f is integrable on [a,b] anda < c < b, then F(x) = sh F(t) dt 
is differentiable at any point Xo in (a,b) where f is continuous, with F'(xo) = f (xo). If 
f is continuous from the right at a, then F\(a) = f(a). If f is continuous from the left 
at b, then F'(b) = f(b). 


Proof We consider the case where a < x9 < b and leave the rest to you (Exer- 


cise 3.3.14). Since 
1 


X—X0 


if "fear FO0, 


we can write 


F(x) — F(xo) 
X — Xo 


~ fo) = —— | “UO — foo) dt. 


From this and Theorem 3.3.5, 


F(x) — F(xo) 
X —X0 


— f (xo) 


= 


: (3.3.13) 


i f(t) — f(xo)| at 


|x — xo| 


(Why do we need the absolute value bars outside the integral?) Since f is continuous at 
Xo, there is for each € > 0 a6 > O such that 


If@) — f@o)|<€ if |x—xo| <4 
and t is between x and x. Therefore, from (3.3.13), 


F —F 7 
EDEINY 964) 2598 HE Pais Se 
Xx — X09 |x — Xo| 


Hence, F’(xo) = f (xo). q 
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Example 3.3.1 If 


then the function 
x oi 0<x < 1, 
Fa)y= | foar=}3 
0 Xx 


— -1, 1<x<2, 
aa, x< 


is continuous on [0, 2]. As implied by Theorem 3.3.11, 


x = f(x), 0<x <1, 
F'(x) = 
x+1l= f(x) 1<x <2, 
= 2 _— 
F,(0) = eu ae - puis wt ides FO), 


FQ@)—-FQ)_ 4, @?/)+x-1-3 
Xx 


F’(2) = lim 
x >2-— =D) x>2-— x—-2 


x>2- 2 


F does not have a derivative at x = 1, where f is discontinuous, since 
F'(1)=1 and Fj(1) =2. a 
The next theorem relates integration and differentiation in another way. 


Theorem 3.3.12 Suppose that F is continuous on the closed interval |a, b] and dif- 
ferentiable on the open interval (a,b), and f is integrable on |a, b]. Suppose also that 


F'(x) = f(x), a<x<b. 


Then ; 
i f(x) dx = F(b) — F(a). (3.3.14) 
Proof If P = {xo,x1,...,Xn} is a partition of [a, b], then 
F(b) — F(a) = Yo (F@)) — F(xj-1)). (3.3.15) 
j=l 


From Theorem 2.3.11, there is in each open interval (x ;~1, x; ) a point c; such that 


F(xj) — F(xj-1) = f(ejs) (ej — x7-1)- 
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Hence, (3.3.15) can be written as 
F(b) — F@) = > fles)(xj —xj-1) =, 
jJ=1 


where o is a Riemann sum for f over P. Since f is integrable on [a, b], there is for each 
€ > 0aé > 0 such that 


b 
of F(x)dx|<e if ||P|| <6. 


Therefore, 


<€ 


b 
FO)- Fa) - f f(x) dx 


for every € > 0, which implies (3.3.14). q 


Corollary 3.3.13 If f' is integrable on [a,b], then 
b 
[ reas = 10)- fo. 


Proof Apply Theorem 3.3.12 with F and f replaced by f and f’, respectively. q 


A function F is an antiderivative of f on [a,b] if F is continuous on [a, b] and differ- 
entiable on (a, b), with 
F'(x) = f(x), a<x<b. 


If F is an antiderivative of f on [a,b], then so is F + c for any constant c. Conversely, 
if F, and F> are antiderivatives of f on [a,b], then F, — F is constant on [a, b] (Theo- 
rem 2.3.12). Theorem 3.3.12 shows that antiderivatives can be used to evaluate integrals. 


Theorem 3.3.14 (Fundamental Theorem of Calculus) /f f is continu- 
ous on [a,b], then f has an antiderivative on [a,b]. Moreover, if F is any antiderivative 


of f on [a,b], then 
b 
/ f(x) dx = F(b) — F(a). 
a 
Proof The function Fo(x) = fe F(t) dt is continuous on [a, b] by Theorem 3.3.10, 
and F5(x) = f(x) on (a,b) by Theorem 3.3.11. Therefore, Fo is an antiderivative of f 


on [a, b]. Now let F = Fo +c (c = constant) be an arbitrary antiderivative of f on [a, b]. 
Then 


b a b 
FO)- Fla) = f foxx +e- | fox)dx—e = f F(x) dx. aa 
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When applying this theorem, we will use the familiar notation 


b 
F(b) — F(a) = F(x) 


a 


Theorem 3.3.15 (Integration by Parts) [fu’ and v’' are integrable on [a, b], 


then 
b 


b b 
J wew'@ dx = uve) -{ v(x)u' (x) dx. (3.3.16) 


a 


a 


Proof Since wu and v are continuous on [a,b] (Theorem 2.3.3), they are integrable on 
[a, b]. Therefore, Theorems 3.3.1 and 3.3.6 imply that the function 

(uv) =u'v + uv’ 
is integrable on [a, b], and Theorem 3.3.12 implies that 


b b 
/ [u(x)u'(x) + ul(x)u(x)] dx = u(x)v(x)] , 
a a 
which implies (3.3.16). 0 
We will use Theorem 3.3.15 here and in the next section to obtain other results. 


Theorem 3.3.16 (Second Mean Value Theorem for Integrals) Suppose 
that f’ is nonnegative and integrable and g is continuous on [a, b]. Then 


b c b 
[ seoswax = fa [ aeoax+ sf eoas G3.17) 
for some c in [a, b]. 
Proof Since f is differentiable on [a, b], it is continuous on [a,b] (Theorem 2.3.3). 


Since g is continuous on [a, b], so is fg (Theorem 2.2.5). Therefore, Theorem 3.2.8 implies 
that the integrals in (3.3.17) exist. If 


G(x) = [ g(t) dt, (3.3.18) 


then G'(x) = g(x), a < x < b (Theorem 3.3.11). Therefore, Theorem 3.3.15 withu = f 
and v = G yields 


b b b 
[ feos ax = seG0) -{ Sf (x)G(x) dx. (3.3.19) 


Since f’ is nonnegative and G is continuous, Theorem 3.3.7 implies that 


b b 
/ Sf’ (x)G(x) dx = Gc | f(x) dx (3.3.20) 
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for some c in [a, b]. From Corollary 3.3.12, 


b 
/ fix)dx = fb) - fa). 


From this and (3.3.18), (3.3.20) can be rewritten as 


b c 
i; f'@OG(x) dx = (FO) — f@) / g(x) dz. 


Substituting this into (3.3.19) and noting that G(a) = 0 yields 


b b Cc 
/ fe dx = fO) / g(x) dx — (f(b) — fla) i eG) dx, 


c b a 
= f(a) i sede FO) ( 1 g(x) dx — / cents) 


c b 
=f f ecar+ sf gorar, 2 


Change of Variable 
The following theorem on change of variable is useful for evaluating integrals. 


Theorem 3.3.17 Suppose that the transformation x = (t) maps the interval c < 
t <d into the intervala < x < b, with¢(c) = a and ¢(d) = B, and let f be continuous 
on [a, b]. Let ¢’ be integrable on [c,d]. Then 


B d 
[ feoax= | S(ot))¢' (t) at. G321) 


Proof Both integrals in (3.3.21) exist: the one on the left by Theorem 3.2.8, the one on 
the right by Theorems 3.2.8 and 3.3.6 and the continuity of f(¢(t)). By Theorem 3.3.11, 
the function 


F(x) = / fo) dy 


is an antiderivative of f on [a, b] and, therefore, also on the closed interval with endpoints 
a and B. Hence, by Theorem 3.3.14, 


B 
/ f(x) dx = F(B) — F(a). (3320) 


By the chain rule, the function 


G(t) = F(¢t)) 
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is an antiderivative of f((t))@’ (t) on [c, d], and Theorem 3.3.12 implies that 


d 
i S(G@)¢$' () dt = G(d) — G(c) = F(¢(d)) — F@()) 
= F(B) — F(a). 
Comparing this with (3.3.22) yields (3.3.21). 


Example 3.3.2 To evaluate the integral 
1/ V2 
l= / (= 907 )0 a2 ak 
—1/V2 


we let 
f@)=0-2x70-PP?, -1/v2<x< 1/2, 
and 
x= ¢(t)=sint, -1/4<t<a7/4. 
Then ¢’(t) = cost and 


1//2 /4 
I -| f(x)dx = f(sint) cost dt 
—1//2 —n/4 


m/4 
= / (1 —2sin? t)(1 — sin? t)~!/? cost dt. 
—7/4 


(1 — sin? 1)!/? =cost,—n/4<t < 1/4 
and 
1 —2sin?t = cos2t, 
(3.3.23) yields 


m/4 
= 1. 


me in2t 
I =| cos2tdt = ca 
—7/4 


—1/4 


Example 3.3.3 To evaluate the integral 


Sa 7 
sint 
= see agi 
9 2+cost 


we take f(t) = cost. Then ¢’(t) = —sint and 
= ¥) Sm 
‘ i 2460" FEO) at, 
where 


1 
TO ae 


(3.3.23) 
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Therefore, since (0) = 1 and #(5z) = —1, 


1 dx =i 
T=- = —log(2+x = log3. | 
[sxe +o] = 08 


These examples illustrate two ways to use Theorem 3.3.17. In Example 3.3.2 we evalu- 
ated the left side of (3.3.21) by transforming it to the right side with a suitable substitution 
x = (t), while in Example 3.3.3 we evaluated the right side of (3.3.21) by recognizing 
that it could be obtained from the left side by a suitable substitution. 


The following theorem shows that the rule for change of variable remains valid under 
weaker assumptions on f if ¢ is monotonic. 


Theorem 3.3.18 Suppose that ' is integrable and ¢ is monotonic on [c, a], and the 
transformation x = $(t) maps [c, d] onto |a, b]. Let f be bounded on [a, b]. Then 


st) = fo) ¢') 


is integrable on [c, d] if and only if f is integrable over |a, b], and in this case 


b d 
[ t@ar=f S(O) |6' (Ol dt. 


Proof We consider the case where f is nonnegative and ¢ is nondecreasing, and leave 
the the rest of the proof to you (Exercises 3.3.20 and 3.3.21). 


First assume that @ is increasing. We show first that 


“Ab nd 
/ F(x) dx -| S(@(t))¢' (0) dt. (3.3.24) 


Let P = {to,t1,...,tn} be a partition of [c,d] and P = {x9,x1,..., Xn} with x; = P(t;) 
be the corresponding partition of [a, b]. Define 
U; = sup {¢'(t) |t7-1 <t < ty}, 
inf {@'(t) |tj-1 St St;}, 
M;= sup { f(x) | xj-1 <x< x7} 


II 


uy 


and 
M ; =sup {f(o(t)¢' (0) |t7-a <t <j}. 
Since ¢ is increasing, u; > 0. Therefore, 
Osu; <P O=U;, fasta. 
Since f is nonnegative, this implies that 
0< SOM); <= SOOO < f@O)U;, tr <t <t;. 


Therefore, _ 
Mjuj <M; < Mj;Uj;, 
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which implies that 


M; = M;p;, (3.3.25) 
where 
Now consider the upper sums 
n n 
S(P) = )>Mj(tj —tj-1) and S(P) = ¥> Mj (xj —x;-1). (3.3.27) 
j=1 j=1 


From the mean value theorem, 
xj —Xj-1 = P(tj) — O(j-1) = YT )(j — tj-1), (3.3.28) 


where t;_1 < tj < tj, so 


uj <¢'(tj) < Uj. (3.3.29) 
From (3.3.25), (3.3.27), and (3.3.28), 
S(P) — S(P) = 9) Mj(p; — $'(t) (tj — tj-1). (3.3.30) 
j=1 


Now suppose that | f(x)| < M,a <x <b. Then (3.3.26), (3.3.29), and (3.3.30) imply 
that 


n 
|S(P) — S(P)| < M GF =i Gj) = 11). 
j=l 

The sum on the right is the difference between the upper and lower sums of ¢’ over P. 
Since ¢’ is integrable on [c, d], this can be made as small as we please by choosing || P || 
sufficiently small (Exercise 3.2.4). 

From (3.3.28), ||P || < K||P|l if |6’@| < K,c <t <d. Hence, Lemma 3.2.4 implies 
that 


an P ar: . : 
s(P)- f f(x)dx| <= and 5) - | FeO) Od] <= B33) 
if || P|| is sufficiently small. Now 
7) aa aa = 
/ f(x)dx— / f(g) ¢' atl < / f(x) dx — S(P)| + |S(P) —3P)| 


+ 


_ Aa. 
SP) - / F(o(t))$" (t) dt 


Choosing P so that |S(P) — S(P| < €/3 in addition to (3.3.31) yields 


<€. 


b d 
i fx)dx — j F(o(d)$' (dt 


Since € is an arbitrary positive number, this implies (3.3.24). 
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If @ is nondecreasing (rather than increasing), it may happen that x;_, = x; for some 
values of 7; however, this is no real complication, since it simply means that some terms in 
S(P) vanish. 


By applying (3.3.24) to —f, we infer that 
b d 
[ terax=[ rowe' war. (3.3.32) 


since 


[cn dx =- i * Weeds 


and 


“hd d 
/ fo!) at =— / FP) dt. 


Now suppose that f is integrable on [a, b]. Then 


b “Ab b 
[ teoax=f feoar =f sooas. 
by Theorem 3.2.3. FiedithiG, (3.3.24), and (3.3.32), 
d hd b 
[ sows oa =f rome ma = teyax. 


This and Theorem 3.2.5 (applied to f((t))@’ (t)) imply that f(#(t))¢’ (¢) is integrable on 
[c, d] and 


b d 
[ seoax= fo powe' war. 6.3.33) 
A similar argument shows that if f(¢(t))¢’ (t) is integrable on [c, d], then f is integrable 
on [a, b], and (3.3.33) holds. q 


3.3 Exercises 


Prove Theorem 3.3.2. 
Prove Theorem 3.3.3. 
Can | f| be integrable on [a, b] if f is not? 


i an 


Complete the proof of Theorem 3.3.6. HINT: The partial proof given above implies 
that if m, and m2 are lower bounds for f and g respectively on |a, b], then 
(f —m,)(g — m2) is integrable on [a, b]. 


5. Prove: If f is integrable on [a,b] and | f(x)| => p > 0 fora < x <b, then 1/f is 
integrable on [a, b] 
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6. 


10. 


11. 


12. 


13. 


14. 
15. 


Suppose that f is integrable on [a, b] and define 


f(x) if f(x) = 0, 
0 if f(x) <0, 


0 if f(x) > 0, 


+ = 
f @=| f(x) if f(x) <0. 


and f (x)= | 
Show that f+ and f~ are integrable on [a, b], and 


[seoar= [ rreoacs [ ree 


Find the weighted average @ of u(x) over [a, b] with respect to v, and find a point c 
in [a, b] such that u(c) = w. 
(a) Ha) =x, v(x) =x, [a,b] = [0,1] 
(b) u(x) = sinx, v(x) =x?, [a,b] =[-1,1] 
(e) ue) =x", v(x) =e*, [a,b] = [0,1] 
Prove Theorem 3.3.9. 
Show that 
c b c 
[ tooax= fo pooax+ [ feyax 
a a b 
for all possible relative orderings of a, b, and c, provided that f is integrable on a 
closed interval containing them. 


Prove: If f is integrable on [a, b] and a = do < ay <--- <d, = 5, then 
b a, a2 an 
i foydx = [ fonds + f foydx set f F(x) dx. 
a ao a\ an-1 


Suppose that f is continuous on [a,b] and P = {xo,X1,..., Xn} is a partition of 
[a, b]. Show that there is a Riemann sum of f over P that equals ie F(x) dx. 


Suppose that /f’ exists and | f’(x)| < M on [a,b]. Show that any Riemann sum o 
of f over any partition P of [a, b] satisfies 


b 
of f(x)dx| < Mb —a)|| PI). 


HINT: See Exercise 3.3.11. 

Prove: If f is integrable and f(x) > 0 on [a, 5], then [ e F(x) dx = 0, with strict 
inequality if f is continuous and positive at some point in [a, b]. 

Complete the proof of Theorem 3.3.11. 


State theorems analogous to Theorems 3.3.10 and 3.3.11 for the function 


G(x) = / f(t) dt, 


and show how your theorems can be obtained from them. 
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16. The symbol { f(x) dx denotes an antiderivative of f. A plausible analog of The- 
orem 3.3.1 would state that if f and g have antiderivatives on [a, b], then so does 
f +g, which is true, and 


[opted =f sonar f ear. (A) 


However, this is not true in the usual sense. 
(a) Why not? 
(b) State a correct interpretation of (A). 


17. (See Exercise 3.3.16.) Formulate a valid interpretation of the relation 


/ (cf (x) dx =e / fadx (£0). 


Is your interpretation valid if c = 0? 
18. (a) Let f+” be integrable on [a, b]. Show that 


F06) = ba +o fh FM — Mat 


HINT: Integrate by parts and use induction. 
(b) What is the connection between (a) and Theorem 2.5.5? 


19. In addition to the assumptions of Theorem 3.3.16, suppose that f(a) = 0, f #0, 
and g(x) > 0 (a < x < b). Show that there is only one point c in [a, b] with the 
property stated in Theorem 3.3.16. HINT: Use Exercise 3.3.13. 


20. Assuming that Theorem 3.3.18 is true under the additional assumption that f is 
nonnegative on [a, b], show that it is true without this assumption. 


21. Assuming that the conclusion of Theorem 3.3.18 is true if ¢ is nondecreasing, show 
that it is true if @ is nonincreasing. HINT: Use Exercise 3.1.6. 


22. Suppose g’ is integrable and f is continuous on [a,b]. Show that - F(x) dg(x) 
exists and equals ibs SF (x)g' (x) dx. 


23. Suppose f and g” are bounded and fg’ is integrable on [a, b]. Show that fe F(x) dg(x) 
exists and equals FI (x)g’ (x) dx. HINT: Use Theorem 2.5.4. 


3.4 IMPROPER INTEGRALS 


So far we have confined our study of the integral to bounded functions on finite closed 
intervals. This was for good reasons: 


e From Theorem 3.1.2, an unbounded function cannot be integrable on a finite closed 
interval. 


152 Chapter 3 Integral Calculus of Functions of One Variable 


e Attempting to formulate Definition 3.1.1 for a function defined on an infinite or semi- 
infinite interval would introduce questions concerning convergence of the resulting 
Riemann sums, which would be infinite series. 


In this section we extend the definition of integral to include cases where f is unbounded 
or the interval is unbounded, or both. 


We say f is locally integrable on an interval J if f is integrable on every finite closed 
subinterval of J. For example, 


f(x) = sinx 


is locally integrable on (—oo, 00); 


1 
go) =D) 


is locally integrable on (—oo, 0), (0, 1), and (1, oo); and 
h(x) = /x 


is locally integrable on [0, 00). 


Definition 3.4.1 If f is locally integrable on [a, b), we define 


b e 
i f(x)dx = sim | f(x) dx (3.4.1) 


if the limit exists (finite). To include the case where b = oo, we adopt the convention that 
oo- = Ow. | 


The limit in (3.4.1) always exists if [a, b) is finite and f is locally integrable and bounded 


on [a, b). In this case, Definitions 3.1.1 and 3.4.1 assign the same value to ve F(x) dx no 
matter how f(b) is defined (Exercise 3.4.1). However, the limit may also exist in cases 
where b = co orb < oo and f is unbounded as x approaches b from the left. In these 
cases, Definition 3.4.1 assigns a value to an integral that does not exist in the sense of Def- 


inition 3.1.1, and ? F(x) dx is said to be an improper integral that converges to the limit 
in (3.4.1). We also say in this case that f is integrable on [a, b) and that Os F(x) dx exists. 
If the limit in (3.4.1) does not exist (finite), we say that the improper integral [, 14 f(x) dx 
diverges, and f is nonintegrable on [a, b). In particular, if lime_,y— 1 f(x) dx = +0, 
we say that ? F(x) dx diverges to +00, and we write 


b b 
[ feax = 0 or J feoax =-v0, 


whichever the case may be. 


Similar comments apply to the next two definitions. 
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Definition 3.4.2 If f is locally integrable on (a, b], we define 


b b 
[ feoax = im, f f(x) dx 


provided that the limit exists (finite). To include the case where a = —oo, we adopt the 
convention that —oo-+ = —oo. 


Definition 3.4.3 If f is locally integrable on (a, b), we define 


b a b 
[ sooax= fo pepax+ [ soras. 
a a Qa 
where a < a < b, provided that both improper integrals on the right exist (finite). | 


The existence and value of 4 F(x) dx according to Definition 3.4.3 do not depend on 
the particular choice of @ in (a, b) (Exercise 3.4.2). 


When we wish to distinguish between improper integrals and integrals in the sense of 
Definition 3.1.1, we will call the latter proper integrals. 


In stating and proving theorems on improper integrals, we will consider integrals of 
the kind introduced in Definition 3.4.1. Similar results apply to the integrals of Defini- 
tions 3.4.2 and 3.4.3. We leave it to you to formulate and use them in the examples and 
exercises as the need arises. 


Example 3.4.1 The function 


1 
f(x) = 2x sin — — cos — 
x x 


is locally integrable and the derivative of 
au 1 
F(x) = x*sin-— 
x 


on [—2/2:, 0). Hence, 


c 


o 1 1 
f(x) dx = x? sin — =c*sin-+ > 
-2/n X |_o/_ c oUt 
and 
9 ee oe 4 
f(x)dx = lim (c sin — + =) =—, 
=2/n c>0- c. 1 m2 


according to Definition 3.4.1. However, this is not an improper integral, even though f(0) 
is not defined and cannot be defined so as to make f continuous at 0. If we define f(0) 
arbitrarily (say f(0) = 10), then f is bounded on the closed interval [—2/z,, 0] and con- 
tinuous except at 0. Therefore, a jee f(x) dx exists and equals 4/7? as a proper integral 
(Exercise 3.4.1), in the sense of Definition 3.1.1. 
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Example 3.4.2 The function 


fx) =(l- x)? 
is locally integrable on [0, 1) and, if p # 1 andO <c <1, 


[o-vra&e =" UE aaa | 
0 


P-1 fo pA 
Hence, 
c _ »)-! 
tim fd —xyP dx = {O p)', p<, 
co l1- 0 oO, p > 1. 
For p = 1, 
c 
lim / et —x)! dx =— lim log(l—c) =o. 
c>1— Jo co l1- 
Hence, 
: -1 
. 1—p) <1 
—x)P dx = (l-p), Pp , 
fa x)? dx +5 eee 


Example 3.4.3 The function 
f@)=x? 
is locally integrable on [1, 00) and, if p # 1 andc > 1, 


c —p+l je —ptl _y 
= x (i 
/ x Pdx= 
1 


—p+l1|,  —ptl 
Hence, 
c — 
lim x Pdx = (p—I)", p>, 
coo Jy oO, p <i. 
For p = 1, 
c 
lim x! dx = lim loge = oo. 
co 1 co 
Hence, 
CO pes, 
x Pdx= ip-= 1) y p>, 
1 oO, pi. 


Example 3.4.4 If 1 <c < oo, then 


a | 1 ap | 1 i 1 > 
—log-—dx =—- —logx dx = —=(logx)*| = -—-=(logc)’. 
1x x i x 2 1 2 


Hence, 
c 


; 1 1 
lim — log — dx = —o0, 
coo Jy xX x 


so 0 | 7 
/ — log —dx = —o0. 
1 x Xx 
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Example 3.4.5 The function f(x) = cos x is locally integrable on [0, 00) and 
c 
lim ii cosxdx = lim sinc 
coo 0 coo 
does not exist; thus, ih cos x dx diverges, but not to -Eoo. 


Example 3.4.6 The function f(x) = log x is locally integrable on (0, 1], but un- 
bounded as x — 0+. Since 


1 


1 
li 1 = ii 1 - =-1l- li 1 —c)=-l 
lim A og x dx in ix ogx — x) ; Jim fe ogc —c) , 
Definition 3.4.2 yields 
1 
/ logx dx =-1. 
0 


Example 3.4.7 In connection with Definition 3.4.3, it is important to recognize that 


the improper integrals [ f(x) dx and : f(x) dx must converge separately for 94 f(x) dx 
to converge. For example, the existence of the symmetric limit 


R 
lim / F(x) dx, 
R->oo —R 


which is called the principal value of {°-, f(x) dx, does not imply that [°° f(x) dx 


converges; thus, 
R 


lim xdx = lim 0=0, 
R>oo J_R R->oo 
but [5° x dx and fee x dx diverge and therefore so does °°. x dx. 


Theorem 3.4.4 Suppose that fi, f2,..., fn are locally integrable on [a, b) and that 
i filx) dx, iy fo(x) dx, ..., is Jn(x) dx converge. Let c\, C2, ..., Cn be constants. 
Then Peat + ¢2 fi +--+ +n fn)(x) dx converges and 


[es + €2 fo ++++ + ¢n fn)(x) dx maf Aerde tes [fords 
ster fi fear, 
Proof Ifa <c <b, then 
fon + 2 fo +++++¢nfn)(x) dx =a f fAcyds+e f’ flas 


tonten | falx) dx, 


by Theorem 3.3.3. Letting c — b— yields the stated result. 0 
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Improper Integrals of Nonnegative Functions 


The theory of improper integrals of nonnegative functions is particularly simple. 


Theorem 3.4.5 /f f is nonnegative and locally integrable on [a,b), then ii F(x) dx 
converges if the function 


F(x) = [ f(t) dt 


is bounded on [a, b), and qe f(x) dx = ov ifitis not. These are the only possibilities, and 


b 
/ f(t)dt = sup F(x) 


a<x<b 
in either case. 
Proof Since F is nondecreasing on [a,b), Theorem 2.1.9(a) implies the conclusion. 


O 


We often write 


b 
/ F(x) dx <o 


to indicate that an improper integral of a nonnegative function converges. Theorem 3.4.5 
justifies this convention, since it asserts that a divergent integral of this kind can only di- 


verge to oo. Similarly, if f is nonpositive and $3 J (x) dx converges, we write 


b 
/ f(x) dx > —oo 


because a divergent integral of this kind can only diverge to —oo. (To see this, apply 
Theorem 3.4.5 to —f.) These conventions do not apply to improper integrals of functions 
that assume both positive and negative values in (a,b), since they may diverge without 
diverging to =Eoo. 


Theorem 3.4.6 (Comparison Test) If f and g are locally integrable on |a, b) 
and 


0< f(x) <ge(x), a<x<b, (3.4.2) 
then 

b b 
(a) / f(x)dx <oo if i: g(x) dx <0o 
and 


b b 
(b) [ seax=00 if J fedx = 00 


a 


Section 3.4 Improper Integrals 157 


Proof (a) Assumption (3.4.2) implies that 


[ toars [ ema a<xx<b 


a 


(Theorem 3.3.4), so 


sup [ f(t)dt < sup [ g(t) dt. 


a<x<b a<x<b 
If f ts g(x) dx < o, the right side of this inequality is finite by Theorem 3.4.5, so the left 
side is also. This implies that (ie F(x) dx < oo, again by Theorem 3.4.5. 
(b) The proof is by contradiction. If i g(x) dx < oo, then (a) implies that { f(x)dx < 
oo, contradicting the assumption that ie f(x) dx = oo. q 


The comparison test is particularly useful if the integrand of the improper integral is 
complicated but can be compared with a function that is easy to integrate. 


Example 3.4.8 The improper integral 
I -[ 2+ sinTx 5. 
aq tla)? 


2+ sinax 3 
SS < 
(l—-x)? ~ (1—-x)P ~ 


converges if p < 1, since 
0< 


and, from Example 3.4.2, 


However, J diverges if p => 1, since 


1 2+ sinax 
0< ———_— < ——_,, 0< x <l, 
(1 — x)? (1 — x)? 
and 
i. dx _ = = 
i= 


If f is any function (not necessarily nonnegative) locally integrable on [a, b), then 
c ay c 
[ torax= [0 royax+ f foyas 
a a a 


if a; and c are in [a,b). Since i F(x) dx is a proper integral, on letting c > b— we 


conclude that if either of the improper integrals i f(x) dx and f f(x) dx converges 
then so does the other, and in this case 


[reoae= [" rooart [ pooae 


158 Chapter 3 Integral Calculus of Functions of One Variable 


This means that any theorem implying convergence or divergence of an improper integral 


f ss F(x) dx in the sense of Definition 3.4.1 remains valid if its hypotheses are satisfied 
on a subinterval [a1,) of [a, b) rather than on all of [a,b). For example, Theorem 3.4.6 
remains valid if (3.4.2) is replaced by 


0< f(x) <2e@), aax<8, 


where a, is any point in [a, b). 
From this, you can see that if f(x) > 0 on some subinterval [a;, ) of [a, b), but not 
necessarily for all x in [a, b), we can still use the convention introduced earlier for positive 


functions; that is, we can write [) bs f(x) dx < oo if the improper integral converges or 
b eee 
J, f(x) dx = on if it diverges. 


Example 3.4.9 If p > 0, then 


SF Be cae 
for x sufficiently large. Therefore, Theorem 3.4.6 and Example 3.4.3 imply that 
- (x — 1)?(2 + sin x) 

1 (= 1/3)" 


converges if p > 1 or diverges if p < 1. 


dx 


Theorem 3.4.7 Suppose that f and g are locally integrable on [a, b), g(x) > 0 and 
F(x) = 00n some subinterval [a1, b) of |a,b), and 


fa ay (3.4.3) 


x—>b— g(x) 
(a) If0 <M <co, then [? f(x) dx and {? g(x) dx converge or diverge together. 
(b) IfM =oo and g(x) dx = ov, then vi f(x) dx = ov. 
(c) fM= Oand f? g(x) dx < 0, then [ f(x) dx < oo. 


Proof (a) From (3.4.3), there is a point a2 in [a, b) such that 


M x 3M 
0< F< az <x <b, 


and therefore - ai 
Zz 8) < f(x) < Zz 8): dz <x <b. (3.4.4) 
Theorem 3.4.6 and the first inequality in (3.4.4) imply that 
b b 
y g(x)dx <oo if / F(x) dx < oo. 
a a2 


2 
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Theorem 3.4.6 and the second inequality in (3.4.4) imply that 


b b 
J fenax <co if [ sear <x. 


2 2 


Therefore, Ms f(x) dx and : g(x) dx converge or diverge together, and in the latter case 
they must diverge to oo, since their integrands are nonnegative (Theorem 3.4.5). 


(b) If M = ov, there is a point az in [a;, b) such that 
f(x) = g(x), aasx<b, 


so Theorem 3.4.6(b) implies that fo f(x)dx =o. 
(c) If M = 0, there is a point az in [a;, b) such that 


I(x) S Be), a2 <x <b, 


so Theorem 3.4.6(a) implies that re f(x) dx < ox. an 
The hypotheses of Theorem 3.4.7(b) and (c) do not imply that re f(x) dx and i g(x) dx 
necessarily converge or diverge together. For example, if b = oo, then f(x) = 1/x 


and g(x) = 1/x? satisfy the hypotheses of Theorem 3.4.7(b), while f(x) = 1/x? and 
g(x) = 1/x satisfy the hypotheses of Theorem 3.4.7(c). However, i 1/xdx = ov, 
while [7° 1/x? dx < oo. 


Example 3.4.10 Let f(x) = (1+ x)? and g(x) = x7”. Since 
fo) _, 


Pare) g(x) 


and i xP dx converges if p > 1 or diverges if p < 1 (Example 3.4.3), Theorem 3.4.7 
implies that the same is true of 


fo +x)? dx. 
1 


Example 3.4.11 The function 
fQ@) =x P(L+x)4 
is locally integrable on (0, 00). To see whether 
Co 
I= i. x P(1+x)% dx 
0 


converges according to Definition 3.4.3, we consider the improper integrals 


1 lee) 
i= i x P?(1+x)%dx and Ih= / x P?(1+x) 4% dx 
0 1 
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separately. (The choice of 1 as the upper limit of 7; and the lower limit of /2 is completely 
arbitrary; any other positive number would do just as well.) Since 


im ~~ ima¢a*=1 
x>0+ xP x>0+ 
and ; 
— »\-1 
/ x P dx = ( P) ’ P < 1, 
0 00, p=, 


Theorem 3.4.7 implies that J; converges if and only if p < 1. Since 


ns ee) 
im — 


= lim(1+x)%x?=1 
x00 xP x00 


and Be ; 
yd dy = SP TI-N, pPta>t, 
i 00, pt+q<sl, 


Theorem 3.4.7 implies that 72 converges if and only if p + gq > 1. Combining these 
results, we conclude that J converges according to Definition 3.4.3 if and only if p < 1 
andp+q> 1. 


Absolute Integrability 


Definition 3.4.8 We say that f is absolutely integrable on [a,b) if f is locally inte- 


grable on [a, b) and lm | f(x)| dx < oo. In this case we also say that < F(x) dx converges 
absolutely or is absolutely convergent. 


Example 3.4.12 If f is nonnegative and integrable on [a, b), then f is absolutely 
integrable on [a, b), since | f| = f. 


Example 3.4.13 Since 


= yp 


and ie x? dx < cif p > 1 (Example 3.4.3), Theorem 3.4.6 implies that 


[pe ; 
x<o, p>l; 
1 


that is, the function 


xP 
is absolutely integrable on [1, 00) if p > 1. It is not absolutely integrable on [1, 00) if 


p <1. To see this, we first consider the case where p = 1. Let k be an integer greater 
than 3. Then 
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_ | sin x| d i | sin x| d 
——dx > ——— 
1 x 4 x 


k-1 


rie |sinx] 
=r f. —— dx (3.4.5) 


k-1 (i+) 
> Lat G+ a | | sinx| dx. 


JT 


But 
(j+1)x cd 
: jsinx|dx = f sinx dx = 2, 
jn 0 
so (3.4.5) implies that 
ie snl , 2 = 
= oan (3.4.6) 
1 IT 
=1/ 
However, 
1 ie dy 
; 2) —, fH 1 2yee5 
ia jt1 x 
so (3.4.6) implies that 


: -1 aj 
km | sin x| 2 by Ped 
——_—— > — — 
1 x a jt+i * 


2 fh dy 2. 47 


— ee a 


Since limg_+9 log[(A + 1)/2] = co, Theorem 3.4.5 implies that 


°° | sin x| 
— dx =o. 
(oe 


Now Theorem 3.4.6(b) implies that 


°° | sin x| 
—dx=om, p<l. (3.4.7) 
1 xP 


Theorem 3.4.9 /f f is locally integrable on [a,b) and is | f(x)|dx < co, then 


fi F(x) dx converges; that is, an absolutely convergent integral is convergent. 


Proof If 
g(x) = |f@)| — f@), 
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then 
0 < g(x) < 2/f(x)| 


and f G g(x) dx < ov, because of Theorem 3.4.6 and the absolute integrability of /. Since 
J =F (—e 


Theorem 3.4.4 implies that : F(x) dx converges. q 


Conditional Convergence 


We say that f is nonoscillatory at b—- (= co if b = oo) if f is defined on [a, b) and 
does not change sign on some subinterval [a1,b) of [a,b). If f changes sign on every 
such subinterval, f is oscillatory at b—. For a function that is locally integrable on [a, b) 
and nonoscillatory at b—, convergence and absolute convergence of i f(x) dx amount 
to the same thing (Exercise 3.4.16), so absolute convergence is not an interesting concept 
in connection with such functions. However, an oscillatory function may be integrable, 
but not absolutely integrable, on [a, b), as the next example shows. We then say that /f is 


conditionally integrable on [a, b), and that // Ee F(x) dx converges conditionally. 


Example 3.4.14 We saw in Example 3.4.13 that the integral 


1p) = [ sin x ae 
1 


xP 


is not absolutely convergent if 0 < p < 1. We will show that it converges conditionally for 
these values of p. 


Integration by parts yields 


Cg _ c 
i SS ies ea = rf aa pre (3.4.8) 
1 1 x 


xP cP 


Since 


COs X 1 
<— 
| xPtl | — xptl 
and i x-?-l dx < oo if p > 0, Theorem 3.4.6 implies that x-?~! cos x is absolutely 
integrable [1, 00) if p > 0. Therefore, Theorem 3.4.9 implies that x?! cos x is integrable 
[1, co) if p > 0. Letting c > oo in (3.4.8), we find that /(p) converges, and 


I(p) = cos 1 ate peo 
(p) = cos =P}, ul x if p>d0o. 


This and (3.4.7) imply that /(p) converges conditionally if 0 < p < 1. | 


The method used in Example 3.4.14 is a special case of the following test for convergence 
of improper integrals. 
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Theorem 3.4.10 (Dirichlet’s Test) Suppose that f is continuous and its an- 
tiderivative F(x) = i. J (t) dt is bounded on [a,b). Let g' be absolutely integrable on 
[a, b), and suppose that 
lim g(x) = 0. (3.4.9) 
x—>b— 


Then ie F(x)g(x) dx converges. 


Proof The continuous function fg is locally integrable on [a, b). Integration by parts 
yields 


ia F(x)g(x) dx = F(c)g(c) -— [ F(x)g'(x)dx, a<c<b. (3.4.10) 


Theorem 3.4.6 implies that the integral on the right converges absolutely as c + b—, since 
i |g’(x)| dx < oo by assumption, and 


|F(x)g’(x)| < MI g’(x)|, 


where M is an upper bound for | F'| on [a, b). Moreover, (3.4.9) and the boundedness of F’ 
imply that lim,_,,- F(c)g(c) = 0. Letting c > b— in (3.4.10) yields 


b b 
/ f@OeWde=- i F(x)e'(x) dx, 


a 
where the integral on the right converges absolutely. q 


Dirichlet’s test is useful only if f is oscillatory at b—, since it can be shown that if f is 


nonoscillatory at b— and F is bounded on [a, b), then i | f(x)g(x)| dx < oo if only g is 
locally integrable and bounded on [a, b) (Exercise 3.4.14). 


Example 3.4.15 Dirichlet’s test can also be used to show that certain integrals di- 


verge. For example, 
lo, 
/ x7 sinx dx 
1 


diverges if g > 0, but none of the other tests that we have studied so far implies this. It 
is not enough to argue that the integrand does not approach zero as x — oo (a common 
mistake), since this does not imply divergence (Exercise 4.4.31). To see that the integral 
diverges, we observe that if it converged for some g > 0, then F(x) = ir x? sinx dx 
would be bounded on [1, 00), and we could let 


f(x) =x%sinx and g(x)=x 7% 


[ee 
/ sinx dx 
1 


also converges. This is false. | 


in Theorem 3.4.10 and conclude that 


164 Chapter 3 Integral Calculus of Functions of One Variable 


The method used in Example 3.4.15 is a special case of the following test for divergence 
of improper integrals. 


Theorem 3.4.11 Suppose that u is continuous on [a, b) and a u(x) dx diverges. Let 
v be positive and differentiable on [a, b), and suppose that lim,_,,— v(x) = 00 and v'/v? 
is absolutely integrable on |a,b). Then c u(x)u(x) dx diverges. 


Proof The proof is by contradiction. Let f = uv and g = 1/v, and suppose that 
c u(x)u(x) dx converges. Then f has the bounded antiderivative F(x) = / i u(t)u(t) dt 
on [a, b), limy+oo g(x) = 0 and g’ = —v’/v? is absolutely integrable on [a, b). Therefore, 
Theorem 3.4.10 implies that ‘4 u(x) dx converges, a contradiction. q 


If Dirichlet’s test shows that /' : Ff (x)g(x) dx converges, there remains the question of 
whether it converges absolutely or conditionally. The next theorem sometimes answers this 
question. Its proof can be modeled after the method of Example 3.4.13 (Exercise 3.4.17). 
The idea of an infinite sequence, which we will discuss in Section 4.1, enters into the 
statement of this theorem. We assume that you recall the concept sufficiently well from 
calculus to understand the meaning of the theorem. 


Theorem 3.4.12 Suppose that g is monotonic on [a, b) and pr g(x) dx = oo. Let f 
be locally integrable on |a, b) and 


Xj 
/ Aire, g=t 
xj 


for some positive p, where {x ;} is an increasing infinite sequence of points in [a,b) such 
that limj—+oo Xj = b and xj41—x; <M, j = 0, for some M. Then 


b 
/ LfG)g(x)| dx = 00. 


Change of Variable in an Improper Integral 


The next theorem enables us to investigate an improper integral by transforming it into 
another whose convergence or divergence is known. It follows from Theorem 3.3.18 and 
Definitions 3.4.1, 3.4.2, and 3.4.3. We omit the proof. 


Theorem 3.4.13 Suppose that ¢ is monotonic and @' is locally integrable on either 
of the half-open intervals I = [c,d) or (c, d], and let x = $(t) map I onto either of the 
half-open intervals J = [a,b) or J = (a,b). Let f be locally integrable on J. Then the 
improper integrals 


b d 
/ flx)dx and i. FACOG 
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diverge or converge together, in the latter case to the same value. The same conclusion 
holds if @ and ¢' have the stated properties only on the open interval (a, b), the transfor- 
mation x = (t) maps (c,d) onto (a, b), and f is locally integrable on (a,b). 


Example 3.4.16 To apply Theorem 3.4.13 to 


lo, ) 
: sinx? dx, 
0 


we use the change of variable x = $(t) = ./t, which takes [c, d) = [0, 00) into [a,b) = 
[0, 00), with f’(t) = 1/(2,/t). Theorem 3.4.13 implies that 


i sinx? dx = — a 
0 2Jo Vt 


Since the integral on the right converges (Example 3.4.14), so does the one on the left. 


/ x ? dx 
1 


converges if and only if p > 1 (Example 3.4.3). Defining ¢(¢) = 1/t and applying 
Theorem 3.4.13 yields 


lee) 1 1 
/ x? dx = / t?|—t-?|dt = / iP ay 
1 0 0 


which implies that re t? dt converges if and only if g > —1. 


Example 3.4.17 The integral 


3.4 Exercises 


1. (a) Let f be locally integrable and bounded on [a, b), and let f(b) be defined 


arbitrarily. Show that f is properly integrable on [a, b], that / is F(x) dx does 
not depend on f(b), and that 


b c 
; f(x)dx = lim , F(x) dx. 
a c>b- Ja 
(b) State a result analogous to (a) which ends with the conclusion that 
b b 
i} f(x)dx = lim / F(x) dx. 
a cat Jeo 


2. Show that neither the existence nor the value of the improper integral of Defini- 
tion 3.4.3 depends on the choice of the intermediate point a. 
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Prove: If c J (x) dx exists according to Definition 3.4.1 or 3.4.2, then pr f(x) dx 
also exists according to Definition 3.4.3. 


Find all values of p for which the following integrals exist (i) as proper integrals 
(perhaps after defining f at the endpoints of the interval) or (ii) as improper inte- 
grals. (iii) Evaluate the integrals for the values of p for which they converge. 


1/x 1 1 
(a) / (ps sin — — x?~? cos -) dx 
0 Xx Xx 


2/1 1 
(b) i (ps Oe +x? sin =) dx 
0 1 Xx 


(c) (ee cP (a) [ox ie [Po xrax. 


Evaluate 


(a) [ e*x"dx (n=0,1,...) (b) , 2 sinx dx 
0 0 
re d d 

© f == (a) — = 


* (cosx  sinx © /sinx  cosx 
- d f d 
(e) [ (2-3) as wf (iets) 


Prove: If // bs J (x) dx exists as a proper or improper integral, then 


b 
tim [ f(t) dt =0. 


Prove: If f is locally integrable on [a,b), then . F(x) dx exists if and only if for 
each € > 0 there is a number r in (a, b) such that 


<€ 


(t) dt 


whenever r < x1, X2 < b. HINT: See Exercise 2.1.38. 


Determine whether the integral converges or diverges. 


OO 7 ae . [o.e) +3 3/2 
(a) | a aoe (b ie ane sin? x dx 
1 + cos? x ° 4+ cosx 
© | Sar @ | aa 


(e) Le + sinx)e ~ dx (f) | 2% + sin x) dx 


10. 


11. 


12. 


13. 


14. 


15. 
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Find all values of p for which the integral converges. 


/2 sin x 7/2 cos x ve 
p,-x 
(a) | a> ax (b) | oe dx (c) | xPe* dx 


m/2  sinx ad dx 1 dx 
(a) | (any? (e) | x (log x)? (f) | x (log x)? 


xdx 
(g yf (sin x)? 


Let Ly (x) be the iterated logarithm defined in Exercise 2.4.42. Show that 


[ dx 

a Lo(x)Li(x)-+- Le (x)[Legi )]? 

converges if and only if p > 1. Here a is any number such that Lz41(x) > 0 for 
x >a. 


Find conditions on p and gq such that the integral converges. 


1 
é yf s (cos on dx (b) a (1 —x)?(1 + x)? dx 
stipe [log + x)? og.x)4 
(c fr (1+ x2)¢ @ eS 
fo) f° state yyy [Ea 


Let f and g be polynomials and suppose that g has no real zeros. Find necessary 
and sufficient conditions for convergence of 


ane 64) ae 
-co &(x) 


Prove: If f and g are locally integrable on [a, b) and the improper integrals /’ f(x) dx 
and [ p g?(x) dx converge, then / is Ff (x)g(x) dx converges absolutely. HINT: (f+ 
ey 20, 


Suppose that f is locally integrable and F(x) = i F(t) dt is bounded on [a, 5), 
and let f be nonoscillatory at b—. Let g be locally integrable and bounded on [a, b). 
Show that 


b 
/ h@eGhl de ece 


Suppose that g is positive and nonincreasing on [a,b) and / i F(x) dx exists as 


a proper or absolutely convergent improper integral. Show that /, ig F(x)g(x) dx 
exists and 
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16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 
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tin Lf roswmar =o. 


HINT: Use Exercise 3.4.6. 

Show that if f is locally integrable on [a, b) and nonoscillatory at b—, then Nig F(x) dx 

exists if and only if i | f(x)| dx < oo. 

(a) Prove Theorem 3.4.12. HINT: See Example 3.4.13. 

(b) Show that g satisfies the assumptions of Theorem 3.4.10 if g’ is locally inte- 
grable, g is monotonic on [a, b), and lim,_,,- g(x) = 0. 


Find all values of p for which the integral converges (i) absolutely; (ii) condition- 
ally. 


© cos x sin x sin x 
(a) | xP - fo x (log x)? Mien fr xP loge” 


°° sin 1 2 
(a) | nts dx (c fo sin” x sin 2x x sin 7 ax (f) [ sin x be 


oo (1 + x2)? 


Suppose that g” is absolutely integrable on ; 00), limy+o0 g’(x) = 0, and lim, g(x) = 


L (finite or infinite). Show that fe g(x) sin x dx converges if and only if L = 0. 

HINT: Integrate by parts. 

Let / be continuous on [0, 00). Prove: 

(a) If [oe 80% A(x) dx converges absolutely, then ij ee) dx converges 
absolutely if s > so. 

(b) If i e *0*h(x) dx converges, then (Pa e **h(x) dx converges if s > so. 

Suppose that f is locally integrable on [0, 00), limy+o0 f(x) = A, anda > -1. 

Find limy +9 x %! ie F(t)t® dt, and prove your answer. 


Suppose that f is continuous and F(x) = as F(t) dt is bounded on [a, b). Suppose 
also that g > 0, g’ is nonnegative and locally integrable on [a, b), andlim,_.,—_ g(x) = 
oo. Show that 


lim a fg(t)dt =0, p>. 
x>b- or 
HINT: Integrate by parts. 


In addition to the assumptions of Exercise 3.4.22, assume that /' i F(t) dt converges. 
Show that 


tim a [ fei) dt =0. 


HINT: Let F(x) = ie F(t) dt, integrate by parts, and use Exercise 3.4.6. 


Section 3.4 Improper Integrals 169 


24. Suppose that f is continuous, g’(x) < 0, and g(x) > 0 on [a, b). Show that if g’ is 
integrable on [a, b) and i Ff (x) dx exists, then Hs FS (x)g(x) dx exists and 


tin Lf roswar =o. 


HINT: Let F(x) = fis F(t) dt, integrate by parts, and use Exercise 3.4.6. 


25. Find all values of p for which the integral converges (i) absolutely; (ii) condition- 
ally. 


1 1 ioe) 
(a) [ x? sin 1/x dx (b) [ | log x|? dx (c) | x? cos(log x) dx 
0 0 1 


CO Co 
(d) / (log x)? dx (e) / sinx? dx 
1 0 
26. Let uw be positive and satisfy the differential equation 


"4 p(xju=0, O<x<oo. (A) 


% dx 
= Se 
0 uj (x) 
° dt 


uz (t) 


(a) Prove: If 


then the function 


PC ere) i 


also satisfies (A), while if 
/ i: ae 
0 uz (x ) 


u2(x) = my [= 


then the function 


i(t) 
also satisfies (A). 


(b) Prove: If (A) has a solution that is positive on [0, oo), then (A) has solutions 
yi and yp that are positive on (0, oo) and have the following properties: 


yi(x)¥5(x) — yi @)y2(x) = 1, x >0, 


yilx) |’ 
Ea < 0, x>Q0, 


and 
yi(x) _ 
n ——= 
x00 y2(x) 
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27. (a) Prove: If h is continuous on [0, 00), then the function 
x 
u(x) =cye* +c2e* + / h(t) sinh(x — t) dt 
0 
satisfies the differential equation 
u” -u=h(x), x>O0. 
(b) Rewrite uv in the form 
u(x) = a(x)e* + b(x)e* 


and show that 
u'(x) = —a(x)e~* + b(x)e*. 


(c) Show that if limy—o. a(x) = A (finite), then 
lim e* [b(x) — B] =0 
x—>o0o 
for some constant B. HINT: Use Exercise 3.4.24. Show also that 
lim e* [u(x) — Ae-* — Be*] = 0. 
x—-oo 
(d) Prove: If limy+o0 b(x) = B (finite), then 
lim u(x)e~* = lim u’(x)e* = B. 
xX—FOO X00: 
HINT: Use Exercise 3.4.23. 
28. Suppose that the differential equation 
u” + p(x)u =0 (A) 


has a positive solution on [0, oo), and therefore has two solutions y; and yz with the 
properties given in Exercise 3.4.26(b). 


(a) Prove: If h is continuous on [0, 00) and c; and c2 are constants, then 


ux) = eryi(s) Heayae) + fh Lry2G) = Cdya(0] dr) 
satisfies the differential equation 
u” + p(x)u = h(x). 
For convenience in (b) and (c), rewrite (B) as 


u(x) = a(x) yi (x) + B(x) ya(x). 
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(b) Prove: If [>° h(t) y2(t) dt converges, then [5° h(t)y1 (t) dt converges, and 


; u(x) — Ayi(Qx) — By2(x) _ 
im = 
x00 yi (x) 


0 


for some constants A and B. HINT: Use Exercise 3.4.24 with f = hyz and 


g§ = yi/Yo. 
(c) Prove: If {5° h(t)y1 (t) dt converges, then 


bs u(x) 
x00 y2(x) — 


for some constant B. HINT: Use Exercise 3.4.23 with f = hy, and g = 
y2/Y1- 
29. Suppose that f, fi, and g are continuous, f > 0, and (f1//)’ is absolutely inte- 
grable on [a, b). Show that e fi(x)g(x) dx converges if ib FI (x)g(x) dx does. 


30. Let g be locally integrable and f continuous, with f(x) > p > 0on [a,b). Sup- 
pose that for some positive M and for every r in [a, b) there are points x; and x2 
such that (a) r < x1 < x2 < b; (b) g does not change sign in [x1, x2]; and 
(c) ey |g(x)|dx > M. Show that Hs ST (x)g(x) dx diverges. HINT: Use Exer- 
cise 3.4.7 and Theorem 3.3.7. 


3.5 A MORE ADVANCED LOOK AT THE EXISTENCE OF 
THE PROPER RIEMANN INTEGRAL 


In Section 3.2 we found necessary and sufficient conditions for existence of the proper 
Riemann integral, and in Section 3.3 we used them to study the properties of the integral. 
However, it is awkward to apply these conditions to a specific function and determine 
whether it is integrable, since they require computations of upper and lower sums and 
upper and lower integrals, which may be difficult. The main result of this section is an 
integrability criterion due to Lebesgue that does not require computation, but has to do 
with how badly discontinuous a function may be and still be integrable. 


We emphasize that we are again considering proper integrals of bounded functions on 
finite intervals. 


Definition 3.5.1 If f is bounded on [a, b], the oscillation of f on [a,b] is defined by 


Wyla,b]= — sup : If) — f@)1, 


a<x,x/< 


which can also be written as 


Wela.b]= sup f(x) —_ ink, £09) 


a<x< 
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( Exercise 3.5.1). Ifa < x <b, the oscillation of f at x is defined by 


w f(x) = jim, We(x —h,x +h). 


The corresponding definitions for x = a and x = b are 
wr(a)= lim Wer(a,at+h) and wy(b)= lim W;(b—/A,b). | 
£( ) h>0+ ( + ) f{ ) h>0+ £( ) 
For a fixed x in (a,b), Wy (x —h, x +h) is a nonnegative and nondecreasing function 


of h for 0 < h < min(x — a,b — x); therefore, w¢(x) exists and is nonnegative, by 
Theorem 2.1.9. Similar arguments apply to w ¢(a) and w ¢ (bd). 


Theorem 3.5.2 Let f be defined on [a,b]. Then f is continuous at xo in [a,b] if 
and only if w (x0) = 0. (Continuity at a or b means continuity from the right or left, 
respectively.) 


Proof Suppose that a < xo < b. First, suppose that w ¢(x9) = 0 and € > 0. Then 
Wy [x0 —h, x9 +h] <e€ 
for some h > 0, so 
[f(x) -— f(x)| <e if xo -A<x,x'< xo +h. 
Letting x’ = xo, we conclude that 
lf) — f@o)|<e€ if |x—xol <A. 


Therefore, f is continuous at Xo. 


Conversely, if f is continuous at x9 and € > 0, there is a 6 > 0 such that 
€ € 
If@) = fol <5 and [f(e")— fo) <5 
if x9 —6 < x, x’ < x9 + 6. From the triangle inequality, 


Lf) — FO) |F@) — FE) + FC’) — F@0)| < €, 


so 
Wel[xo-h,xoth])<e if h<6; 


therefore, w ¢(xo) = 0. Similar arguments apply if x9 = a or x9 = b. q 


Lemma 3.5.3 If wf(x) < € fora < x < b, then there is a 6 > O such that 
We lai. 51] < €, provided that [a,, b1] C [a, b] and by — a, <5. 


Proof We use the Heine—Borel theorem (Theorem 1.3.7). If w(x) < €, there is an 
hy > O such that 
Fe = fe) << (3.5.1) 
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if 
x —2hy <x',x" <x+2h, and x’,x” € [a,b]. (3.5.2) 
If I, = (x — hy, x +h,), then the collection 
H = {I,|a<x <b} 


is an open covering of [a,b], so the Heine—Borel theorem implies that there are finitely 
many points x1, X2,..., X, in [a, b] such that J,,, Ix,,..., Ix, cover [a, b]. Let 


h= min hy, 
1<i<n 


and suppose that [a1,b,] C [a,b] and b} — a, < h. If x’ and x” are in [a,, by], then 
x’ € I,, forsome r (1 < r <n), so 


|x’ — x;| < hy,.. 
Therefore, 


|x” — x,| < |x" — x’| + |x’ — x-| < by — a1 + hx, 
2 hed ee, 


Thus, any two points x’ and x” in [a1, 5] satisfy (3.5.2) with x = x,, so they also satisfy 
(3.5.1). Therefore, € is an upper bound for the set 


(FO) — £&")| |x! x” € [ar bi}, 
which has the supremum W¢ [a1, bi]. Hence, Wy [a1, 51] < €. q 
In the following, L(/) is the length of the interval /. 


Lemma 3.5.4 Let f be bounded on [a, b] and define 


Ep = 1% € [a,b] | w ¢(x) > p}. 
Then Ey is closed, and f is integrable on |a, b] if and only if for every pair of positive 


numbers p and 6, E, can be covered by finitely many open intervals I,, Iz,..., Ip such 
that 
P 
y> LU) <6. (3.5.3) 
j=l 


Proof We first show that E, is closed. Suppose that x9 is a limit point of Ep. If h > 0, 
there is an X from Ey in (xo —h, x9 +h). Since [x —hy,x + hy] C [xo —h, xo + A] for 
sufficiently small h and Wy [x — h1,X + hy] = p, it follows that Wy [x9 —h, xo +h] = p 
for all h > 0. This implies that x9 € Ep, so Ey is closed (Corollary 1.3.6). 


Now we will show that the stated condition in necessary for integrability. Suppose that 
the condition is not satisfied; that is, there is a p > 0 anda6é > 0 such that 


Pp 
YL iGes 
j=l 
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for every finite set {J1, I2,..., Zp} of open intervals covering Ey. If P = {x0,%1,...,Xn} 
is a partition of [a, b], then 


S(P)—s(P) = SoM; —my)(x; —Xx;-1) + SoM; —mj)(xj; —xj-1), (3.5.4) 


jeA eB 
where 
A= {j|[xj-1,.xj]M Ep #0} and B= {j | [xj-1,xj] Ep = 9}. 
Since Ujea (x;—-1, x;) contains all points of E' except any of Xo, x1, ..., Xn that may 


be in Ep, and each of these finitely many possible exceptions can be covered by an open 
interval of length as small as we please, our assumption on E’, implies that 


D5 @; —xj-1) = 6. 
jeA 
Moreover, if j € A, then 
Mj; —m; = p, 
so (3.5.4) implies that 
S(P)—s(P) = p >; — xj-1) = 96. 
JEA 


Since this holds for every partition of [a, b], f is not integrable on [a, b], by Theorem 3.2.7. 
This proves that the stated condition is necessary for integrability. 


For sufficiency, let p and 6 be positive numbers and let /;, 12, ..., Zp be open intervals 
that cover Ep and satisfy (3.5.3). Let 
T; = [a,b] NT;. 


(I; = closure of 7.) After combining any of Te To, ..., Tp that overlap, we obtain a set 
of pairwise disjoint closed subintervals 


Cj =([o;,8)), 1sji sap), 
of [a, b] such that 


a <a < By < a2 < Bo-++ < Mg_-1 < Bg-1 < dq < Bg <4, (3.5.5) 


q 
> Bi —aj) <6 (3.5.6) 
i=l 
and 
wr(x)<p, By Sx S<aju1, 1s jx<q-l. 


Also, w f(x) < pfora < x < a, ifa < a, and for By < x < bif By <b. 
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Let Po be the partition of [a, b] with the partition points indicated in (3.5.5), and refine 
Po by partitioning each subinterval [6 ;,o;+1] (as well as [a,o 1] if a < a and [B,, b] 
if Bg < b) into subintervals on which the oscillation of f is not greater than p. This is 
possible by Lemma 3.5.3. In this way, after renaming the entire collection of partition 
points, we obtain a partition P = {xo, X1,..., Xn} of [a, b] for which S(P) — s(P) can be 
written as in (3.5.4), with 


q 
Yo (xy —xj-1) = D5 (Bi — a) <8 
jeA i=l 


(see (3.5.6)) and 
Mj-mj<p, j€B. 


For this partition, 


> (M; —mj)(xj —xj;-1) < 2K > (xj —xj-1) < 2K6, 
JEA jéA 


where K is an upper bound for | f| on [a, b] and 


5 (Mj — mi)(xj — xj-1) < p(b- a). 


jeB 


We have now shown that if p and 6 are arbitrary positive numbers, there is a partition P of 
[a, b] such that 


S(P)—s(P) <2K6 + p(b—a). (3.5.7) 
Ife > 0, let 2 P 
6= IK and p= Sea. 
Then (3.5.7) yields 
S(P) —s(P) <e, 
and Theorem 3.2.7 implies that f is integrable on [a, 5]. q 


We need the next definition to state Lebesgue’s integrability condition. 


Definition 3.5.5 A subset S of the real line is of Lebesgue measure zero if for every 


€ > O there is a finite or infinite sequence of open intervals /;, /2,... such that 
scUa4 (3.5.8) 
J 
and 
n 
YOLUj)<e, nel. (3.5.9) 
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Note that any subset of a set of Lebesgue measure zero is also of Lebesgue measure zero. 
(Why?) 


Example 3.5.1 The empty set is of Lebesgue measure zero, since it is contained in 
any open interval. 


Example 3.5.2 Any finite set S = {x1,X2,...,Xn,} is of Lebesgue measure zero, 
since we can choose open intervals 1;, 2, ..., In such that x; € 1; and LU;) < €/n, 
1l<j <n. 


Example 3.5.3 An infinite set is denumerable if its members can be listed in a se- 
quence (that is, in a one-to-one correspondence with the positive integers); thus, 


S = {x1,%2,...,Xn,.-.}. (3.5.10) 


An infinite set that does not have this property is nondenumerable. Any denumerable set 
(3.5.10) is of Lebesgue measure zero, since if € > 0, it is possible to choose open intervals 
I, Iz,..., so that x; € J; and L(U/;) < 2-Se, J = 1. Then (3.5.9) holds because 


ay ae ts are (3.5.11) 
2° 22° 93 Qn Qn , ce 
a 


There are also nondenumerable sets of Lebesgue measure zero, but it is beyond the scope 
of this book to discuss examples. 


The next theorem is the main result of this section. 


Theorem 3.5.6 A bounded function f is integrable on a finite interval [a, b] if and 
only if the set S of discontinuities of f in |a, b] is of Lebesgue measure zero. 


Proof From Theorem 3.5.2, 
S = {x € [a,b] |wy(x) > 0}. 


Since w ¢(x) > 0 if and only if w (x) = 1/i for some positive integer i, we can write 


S= 'e Si; (3.5.12) 


where 
S; = {x € [a,b] | wy (x) > 1/i}. 


Now suppose that f is integrable on [a,b] and « > 0. From Lemma 3.5.4, each $; can 
be covered by a finite number of open intervals Jj1, Ji2, ..., Jin of total length less than 
€/2'. We simply renumber these intervals consecutively; thus, 


Fe Tie ig seed es Biss: 


Now (3.5.8) and (3.5.9) hold because of (3.5.11) and (3.5.12), and we have shown that the 
stated condition is necessary for integrability. 
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For sufficiency, suppose that the stated condition holds and « > 0. Then S can be 
covered by open intervals /;, /2,... that satisfy (3.5.9). If o > 0, then the set 


E, = {x € [a,b] |wy(x) > p} 


of Lemma 3.5.4 is contained in S$ (Theorem 3.5.2), and therefore Ep is covered by 11, Iz, .... 
Since E,, is closed (Lemma 3.5.4) and bounded, the Heine—Borel theorem implies that EF’ 
is covered by a finite number of intervals from /1, Jo,.... The sum of the lengths of the 
latter is less than €, so Lemma 3.5.4 implies that f is integrable on [a, b]. q 


3.5 Exercises 


1.  Inconnection with Definition 3.5.1, show that 


sup Lf) — f= sup fo) —, inf, £00. 


x,x’€[a,b] 


2. Use Theorem 3.5.6 to show that if f is integrable on [a,b], then so is | f| and, if 
f(x) =p>0(a<x <b), sois1/f. 

3. Prove: The union of two sets of Lebesgue measure zero is of Lebesgue measure 
zero. 


4. Use Theorem 3.5.6 and Exercise 3.5.3 to show that if f and g are integrable on 
[a, b], then so are f + g and fg. 
5. Suppose /f is integrable on [a,b], a = infa<x<p f(x), and B = supgcy<p f(x). 
Let g be continuous on [a, 6]. Show that the composition h = g o f is integrable 
on [a, b]. 
6. Let f be integrable on [a, b], leta = infg<x<p f(x) and B = supy<,<, f(x), and 
suppose that G is continuous on [a, 6]. For each n > 1, let 
j —1)(b- i(b — 
j -\6—a) pay ae 


gg Ve!) <Ujn, Vin S 
>4jn jn > 
n , n 


1l<j <n. 
Show that 


1 n 
fim, — 97 1G(f(ujn)) — GF @jn))| = 0. 
j=l 


7. Let h(x) = 0 for all x in [a,b] except for x in a set of Lebesgue measure zero. 


. b ‘ ‘ 
Show that if {°° h(x) dx exists, it equals zero. HINT: Any subset of a set of measure 
zero is also of measure zero. 


8. Suppose that f and g are integrable on [a, b] and f(x) = g(x) except for x ina set 
of Lebesgue measure zero. Show that 


” 60%) dx = “ee dx. 
[ AOR, 


CHAPTER 4 


Infinite Sequences and Series 


IN THIS CHAPTER we consider infinite sequences and series of constants and functions 
of a real variable. 


SECTION 4.1 introduces infinite sequences of real numbers. The concept of a limit of a 
sequence is defined, as is the concept of divergence of a sequence to too. We discuss 
bounded sequences and monotonic sequences. The limit inferior and limit superior of a 
sequence are defined. We prove the Cauchy convergence criterion for sequences of real 
numbers. 


SECTION 4.2 defines a subsequence of an infinite sequence. We show that if a sequence 
converges to a limit or diverges to oo, then so do all subsequences of the sequence. Limit 
points and boundedness of a set of real numbers are discussed in terms of sequences of 
members of the set. Continuity and boundedness of a function are discussed in terms of the 
values of the function at sequences of points in its domain. 


SECTION 4.3 introduces concepts of convergence and divergence to -too for infinite series 
of constants. We prove Cauchy’s convergence criterion for a series of constants. In con- 
nection with series of positive terms, we consider the comparison test, the integral test, the 
ratio test, and Raabe’s test. For general series, we consider absolute and conditional con- 
vergence, Dirichlet’s test, rearrangement of terms, and multiplication of one infinite series 
by another. 


SECTION 4.4 deals with pointwise and uniform convergence of sequences and series of 
functions. Cauchy’s uniform convergence criteria for sequences and series are proved, as 
is Dirichlet’s test for uniform convergence of a series. We give sufficient conditions for 
the limit of a sequence of functions or the sum of an infinite series of functions to be 
continuous, integrable, or differentiable. 


SECTION 4.5 considers power series. It is shown that a power series that converges on 
an open interval defines an infinitely differentiable function on that interval. We define 
the Taylor series of an infinitely differentiable function, and give sufficient conditions for 
the Taylor series to converge to the function on some interval. Arithmetic operations with 
power series are discussed. 


178 


Section 4.1 Sequences of Real Numbers 179 


4.1 SEQUENCES OF REAL NUMBERS 


An infinite sequence (more briefly, a sequence) of real numbers is a real-valued function 
defined on a set of integers {n | n= k}. We call the values of the function the terms of the 
sequence. We denote a sequence by listing its terms in order; thus, 


{sale = (8k, Sk41.---}- (4.1.1) 


Ee re Pee 1 
m+ify (2s wer os? 
1 


{(-1)"}9° = (1,-1,1,...,(CD",...}, 


to 1 
Poa, pea acc mae fe 


The real number s,, is the nth term of the sequence. Usually we are interested only in the 
terms of a sequence and the order in which they appear, but not in the particular value of k 
in (4.1.1). Therefore, we regard the sequences 


1 )° as 
teal, ™ Tal 
n—2)., n)y 


We will usually write {s,} rather than {s,}?°. In the absence of any indication to the 
contrary, we take k = 0 unless s, is given by a rule that is invalid for some nonnegative 
integer, in which case k is understood to be the smallest positive integer such that s, is 
defined for all n > k. For example, if 


For example, 


and 


as identical. 


1 
a (n —1)(n —5)’ 
then k = 6. 


The interesting questions about a sequence {s,} concern the behavior of s, for large n. 


Limit of a Sequence 


Definition 4.1.1 A sequence {s,} converges to a limit s if for every « > 0 there is an 
integer N such that 
Ion —s|<e if n>N. (4.1.2) 


In this case we say that {s,} is convergent and write 
lim sy, = 5S. 
n—-oo 


A sequence that does not converge diverges, or is divergent | 
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As we saw in Section 2.1 when discussing limits of functions, Definition 4.1.1 is not 
changed by replacing (4.1.2) with 


lsn —s|< Ke if n>=N, 
where K is a positive constant. 
Example 4.1.1 Ifs, =c forn > k, then |s,—c| = 0forn > k, and limp+oo Sn = C. 


Example 4.1.2 If 


2n+1 
Sy = ; 
* n+1 
then limy-+o9 Sn = 2, since 
| = 2n+1l an+2) 1 | 
ee wed n+l] atl’ 
hence, if € > 0, then (4.1.2) holds with s = 2if N > 1/e. | 


Definition 4.1.1 does not require that there be an integer N such that (4.1.2) holds for 
all €; rather, it requires that for each positive € there be an integer N that satisfies (4.1.2) 
for that particular €. Usually, N depends on € and must be increased if € is decreased. The 
constant sequences (Example 4.1.1) are essentially the only ones for which N does not 
depend on € (Exercise 4.1.5). 

We say that the terms of a sequence {5,}?° satisfy a given condition for all n if Sy satisfies 
the condition for all n > k, or for large n if there is an integer N > k such that s, satisfies 
the condition whenever n > N. For example, the terms of {1/n}?° are positive for all n, 
while those of {1 — 7/n}$° are positive for large n (take N = 8). 


Uniqueness of the Limit 
Theorem 4.1.2 The limit of a convergent sequence is unique. 


Proof Suppose that 


lims,=s and lims, =s’. 
n—-oo n—-oo 


We must show that s = s’. Let € > 0. From Definition 4.1.1, there are integers N, and N 
such that 
lsn -—s|<e if n>M, 


(because limy+99 Sy = S), and 


lsn —s'|<e if n>Np 
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(because limy—+oo Sn = 5’). These inequalities both hold if nm > N = max(N;, N2), which 


implies that 


Is —s‘| = |(s —sw) + (sw -8')| 
< |s —sy|+|sn —s'| <e +e =2e. 
Since this inequality holds for every « > 0 and |s — s’| is independent of €, we conclude 
that |s — s’| = 0; that is, s = 5’. q 
Sequences Diverging to +oo 


We say that 
lim sy, = co 
n—-oo 


if for any real number a, s, > a for large n. Similarly, 


lim s;, = —oo 
noo 


if for any real number a, s, < a for large n. However, we do not regard {s,} as convergent 
unless lim,—+o0 Sy is finite, as required by Definition 4.1.1. To emphasize this distinction, 
we say that {s,} diverges to 00 (—oo) if limy—+g9 5, = 00 (—00). 


Example 4.1.3 The sequence {n/2 + 1/n} diverges to 00, since, if a is any real num- 


ber, then 


n 1 . 
—-+-—>a if n>2a. 
2 én 


The sequence {n — n7} diverges to —oo, since, if a is any real number, then 
—n? +n=-n(n-1)<a if n>1+ lal. 


Therefore, we write 


and 


lim (—n? +n) =—o0. 
n—-oo 


The sequence {(—1)"n3} diverges, but not to —oo or oo. 


Bounded Sequences 


Definition 4.1.3 A sequence {s,} is bounded above if there is a real number b such 
that 
$n <b foralln, 


bounded below if there is a real number a such that 
S, >a _ foralln, 
or bounded if there is areal number r such that 


lsn| <r foralln. 
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Example 4.1.4 If s, = [1 + (—1)"]n, then {s,} is bounded below (s, > 0) but 
unbounded above, and {—s,,} is bounded above (—s, < 0) but unbounded below. If s, = 
(—1)”, then {s,,} is bounded. If s, = (—1)”n, then {s,,} is not bounded above or below. 


Theorem 4.1.4 A convergent sequence is bounded. 
Proof By taking e = 1 in (4.1.2), we see that if limy+oo Sy = S, then there is an integer 


N such that 
lsn —s| <1 if nN. 


Therefore, 
lsn| = |(Sn —5) + 5| < [Sn —s| + |s]|< 14+ |s| if n=QN, 
and 
lSn| < max{|sol, |S1|,..-,|sy—1], 1 + [s|} 
for all n, so {s,} is bounded. q 


Monotonic Sequences 


Definition 4.1.5 A sequence {s,} is nondecreasing if 8, > Sy— for all n, or nonin- 
creasing if Sy < S,—1 for all n. A monotonic sequence is a sequence that is either nonin- 
creasing or nondecreasing. If s, > s,—, for alln, then {s,,}1is increasing, whileif sy < Sy—1 
for all n, {sy} is decreasing. 


Theorem 4.1.6 
(a) If {sn} is nondecreasing, then limp—+oo Sn = sup{Sn}. 


(b) Jf {sn} is nonincreasing, then limn+oo Sn = inf{sp}. 
Proof (a). Let 8 = sup{s,}. If B < oo, Theorem 1.1.3 implies that if ¢ > 0 then 
B-€<sy <6 
for some integer NV. Since sy < sy, < B ifn > N, it follows that 
B-é€<5,<f if n>N. 


This implies that |s, —B| < «ifn > N, so limpoo Sn = B, by Definition 4.1.1. If B = oo 
and b is any real number, then sy > b for some integer N. Then s, > b forn > N, so 
limy-+o0 Sn = OC. 


We leave the proof of (b) to you (Exercise 4.1.8) a 


Example 4.1.5 Ifso = 1 ands, = 1—e7*"—', then0 < s, < 1 forall n, by induction. 
Since 
Snti —Sn = —(e" —e"—!) if n=, 
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the mean value theorem (Theorem 2.3.11) implies that 
Sn41—Sn =e (Sn —Sn-1) if n>, (4.1.3) 


where ¢, is between s,—; and s,. Since s1 — 59 = —1/e < 0, it follows by induction from 
(4.1.3) that 5,41 — 5, < 0 for all n. Hence, {s,} is bounded and decreasing, and therefore 
convergent. 


Sequences of Functional Values 


The next theorem enables us to apply the theory of limits developed in Section 2.1 to some 
sequences. We leave the proof to you (Exercise 4.1.13). 


Theorem 4.1.7 Letlimyo0. f(x) = L, where L is in the extended reals, and suppose 


that Sn = f(n) for large n. Then 
lim s, = L. 
n—-oo 


Example 4.1.6 Let 


logn log x 
Sn = 28" and f(x)= 2 
n x 
By L’Hospital’s rule, 
1 1 
lim = — Ve =0 
x>00 X x00 | 


Hence, limp logn/n = 0. 


Example 4.1.7 Lets, = (1 +1/n)” and 


x 
fey= (142) <emenen 
x 
By L’Hospital’s rule, 


1 log(i + 1 
lim x log (: + ~) = lim log(1 + 1/x) 
x00 x x00 1/x 
1 1 
x2 14+ 1/x 
m —— ——— _ = 1; 
X00 —1/x? 


hence, 
1\* 1\” 
lim (1+ =) =e'=e and lim (1+-) =e. 
x—0o x noo nN 


The last equation is sometimes used to define e. 
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Example 4.1.8 Suppose that s, = p” with p > 0, and let f(x) = p* = e*!2°. Since 


0, ifloge<0 (0<p<\l1), 
lim e7'8° = 21, iflogo=0 (9 =1), 
x 0O 


co, iflogo>0 (p>1), 


it follows that 


0, O<p<l, 
lim p°= 41, p=1, 
n—->oo 
oo, p>. 
Therefore, 

0, -l<r<l, 
limr” =21, r=1, 
nao 

oo, r>l, 


a result that we will use often. 


A Useful Limit Theorem 


The next theorem enables us to investigate convergence of sequences by examining simpler 
sequences. It is analogous to Theorem 2.1.4. 


Theorem 4.1.8 Let 
lim s,=s and lim t, =t, (4.1.4) 
no noo 


where s and t are finite. Then 


lim (cS,) = cs (4.1.5) 
n—->oo 
if c is a constant; 
lim (Ss, +t) =s +t, (4.1.6) 
n—->oo 
lim (Ss, —t,) =s-t, (4.1.7) 
no 
lim (Sptn) = St, (4.1.8) 
no 
and 
im 22 (4.1.9) 
noo ty t 


if tn is nonzero for alln andt # 0. 


Proof We prove (4.1.8) and (4.1.9) and leave the rest to you (Exercises 4.1.15 and 
4.1.17). For (4.1.8), we write 


Sntn — St = Syty — Sty + Sty — St = (Sn —S)tn + S(tn — 1); 
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hence, 
ISntn — St| < |Sn — $| |tn| + |8| [tn — t]. (4.1.10) 
Since {t,} converges, it is bounded (Theorem 4.1.4). Therefore, there is a number R such 
that |t,| < R for all m, and (4.1.10) implies that 
[Sntn —St| < Rlsn —s| + |5| |r —¢l. (4.1.11) 
From (4.1.4), if € > 0 there are integers Ny and N2 such that 


ln —s|<e if n=>M (4.1.12) 
and 
Ita —tl<e if n>WNpo. (4.1.13) 
If N = max(Nj, N2), then (4.1.12) and (4.1.13) both hold when n > N, and (4.1.11) 
implies that 
lSntn —St| <(R+ Ise if n=QN. 
This proves (4.1.8). 
Now consider (4.1.9) in the special case where s,, = 1 for all andt ¥ 0; thus, we want 
to show that 
lim —=-. 
noo tn t 
First, observe that since limp—oo tn = t # 0, there is an integer M such that |t,| > |t|/2 
ifn > M. To see this, we apply Definition 4.1.1 with « = |t|/2; thus, there is an integer 
M such that |t, — t| < |t/2| ifn => M. Therefore, 
[2 


Ite] = | + Ge —O) 2 [él — lem — el = if n>=M. 


If € > 0, choose No so that |t, —t| < ¢€ ifm > No, and let N = max(No, M). Then 
1 1 


tn t 


|t —tn| Qe 
= Sao = 

Itn| |e] ~ |e| 
hence, limy—+oo 1/t, = 1/t. Now we obtain (4.1.9) in the general case from (4.1.8) with 
{tn} replaced by {1/ty}. q 


Example 4.1.9 To determine the limit of the sequence defined by 
1. nx 2014+3/n) 


Sy = —sin — 
n 


4 = 1+1/n ’ 
we apply the applicable parts of Theorem 4.1.8 as follows: 


1 2) lim 1+ 3 lim (1/n) 
F : _ A noo noo 
lim sy, = lim —sin — — —————— 
n—->00 noo nl 4 lim 1+ lim (1/n) 
n—->oo n—->oo 
2(1 + 3-0) 


= 0 + ————— = 2. 
* 1+0 
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Example 4.1.10 Sometimes preliminary manipulations are necessary before applying 
Theorem 4.1.8. For example, 


(n/2) + logn . 1/2+ (logn)/n 

im ——=— = lim ~~ = 
noo 3n+4./n noo 34 4n71/2 
lim 1/2+ lim (logn)/n 
n—->oo n—->oo 

lim 3 + 4 lim n7!/? 

noo n—->oo 

_ 1/240 


340 (see Example 4.1.6) 


= 
5 
Example 4.1.11 Suppose that —1 <r < 1 and 
so=1, sp=1tr, so=ltrtr’,..., sp=ltrt tr". 
Since 
Sn —TSn = (Ltr te tr) -(7 tr? 4 pr) =1- 7", 


it follows that 
i= pti 


Sy = ——. (4.1.14) 
l-r 


From Example 4.1.8, limy— 9 r@+l — 0, so (4.1.14) and Theorem 4.1.8 yield 
1 
lim (l+r+---+r") = — if -l<r<l. a 
noo l-—r 
Equations (4.1.5)—-(4.1.8) are valid even if s and ¢ are arbitrary extended reals, provided 
that their right sides are defined in the extended reals (Exercises 4.1.16, 4.1.18, and 4.1.21); 
(4.1.9) is valid if s/t is defined in the extended reals and t 4 0 (Exercise 4.1.22). 


Example 4.1.12 If—1 <r <1, then 


0 jim 0 
lim — = — = 0, 
noo n! lim n! lee) 
n—->oo 


from (4.1.9) and Example 4.1.8. However, if r > 1, (4.1.9) and Example 4.1.8 yield 


n lim r” 
: r noo 
lim — = — =—, 
noo n! lim n! lee) 
n-co 


an indeterminate form. If r < —1, then lim,., r” does not exist in the extended reals, so 
(4.1.9) is not applicable. Theorem 4.1.7 does not help either, since there is no elementary 
function f such that f(7) = r”/n!. However, the following argument shows that 
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n 


im =O =< 7 < ee: (4.1.15) 
There is an integer M such that 
Fl) 1d 
—<- if n>M 
n 2, 


Let K = r™”/M!. Then 


|r|" Ir} Ir Ir| al 
Be ee eR , n>M. 
n! M+1M42 n 2 


Given € > 0, choose N > M so that K/2N-™ < €. Then |r|"/n! < € ifn > N, which 
verifies (4.1.15). 


Limits Superior and Inferior 


Requiring a sequence to converge may be unnecessarily restrictive in some situations. Of- 
ten, useful results can be obtained from assumptions on the limit superior and limit inferior 
of a sequence, which we consider next. 


Theorem 4.1.9 


(a) If {sn} is bounded above and does not diverge to —oo, then there is a unique real 
number 8 such that, if € > 0, 


Sn <S+e forlargen (4.1.16) 


and 
Sn >S—€ for infinitely many n. (4.1.17) 


b) Jf {s,: is bounded below and does not diverge to oo, then there is a unique real 
[ 8 q 
number s such that, if € > 0, 


Sn >s—€ forlargen (4.1.18) 


and 
Sn <S+€ for infinitely many n. (4.1.19) 


Proof We will prove (a) and leave the proof of (b) to you (Exercise 4.1.23). Since 
{Sn} is bounded above, there is a number 6 such that s, < # for all n. Since {s,} does not 


diverge to —oo, there is a number @ such that s, > a for infinitely many n. If we define 


My = sup{sx, Sk4i,-++sSktrs-++}s 
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thena < My < B,so {Mx} is bounded. Since {M;} is nonincreasing (why?), it converges, 
by Theorem 4.1.6. Let 
5s = lim Mg. (4.1.20) 
k->oo 


Ife > 0, then M, <5 +4 € for large k, and since s, < M;, forn > k, 5 satisfies (4.1.16). 


If (4.1.17) were false for some positive €, there would be an integer K such that 
S,<S-—e if n>K. 


However, this implies that 
M, <s-—e if k>K, 


which contradicts (4.1.20). Therefore, s has the stated properties. 


Now we must show that sis the only real number with the stated properties. If t <5, the 
inequality 


re i _ y-t 
Sn < ——— = §- 
% 2 2 


cannot hold for all large n, because this would contradict (4.1.17) with e = (s —t)/2. If 
S < f, the inequality 


t-S  _ rs t—35 
=5 

2 2 
cannot hold for infinitely many n, because this would contradict (4.1.16) withe = (t—s)/2. 


Therefore, 5 is the only real number with the stated properties. 


Sn >t— 


Definition 4.1.10 The numbers ¥ and s defined in Theorem 4.1.9 are called the limit 
superior and limit inferior, respectively, of {s,}, and denoted by 


s= lim s, and s= lim Sy. 
noo _ n—>0oo 


We also define 


lim s, = oo if {s,}1is not bounded above, 
noo 
lim s, =—oo if lim sy, = -—«~, 
n—->oo n—->oo 
lim s,; =—oco if {s,} is not bounded below, 
noo 
and : ep a 
lim s, = co if lim s, =o. 
noo Tr OO 


Theorem 4.1.11 Every sequence {sy} of real numbers has a unique limit superior, 5, 
and a unique limit inferior, s, in the extended reals, and 


s<F. (4.1.21) 
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Proof The existence and uniqueness of 5 and s follow from Theorem 4.1.9 and Defini- 
tion 4.1.10. If 5 and s are both finite, then (4.1.16) and (4.1.18) imply that 


s-—€<S+e 


for every € > 0, which implies (4.1.21). If s = —co or 5 = oo, then (4.1.21) is obvious. If 
5 = wors = —o0, then (4.1.21) follows immediately from Definition 4.1.10. an 


Example 4.1.13 


—_ co, |r| > 1, 
limr’= 41, |rlj=1, 
— 0, I|r|<1 
and 
oo, r>il, 
1, r=1, 
lim r” = O,. [rl <1, 
n—->oo =], r= —l, 
-—o, r<-l 
Also, 
im Wo = in OS 
n=?00 n—>oo 
Tiss n 1 ‘ n 1 
lim (-1)"(1——}=1, lim (-1)" [n-——) =-1, 
Tere n noo n 
and 


lim [1 + (-1)"]n? = 00, lim [1 + (—1)"]n? =0. 


n—->oco 


Theorem 4.1.12 If {s,} is a sequence of real numbers, then 


lim s, =s (4.1.22) 
noo 
if and only if 
lim s, = lim sy, =s. (4.1.23) 
Tre n—>oo 


Proof Ifs = tox, the equivalence of (4.1.22) and (4.1.23) follows immediately from 
their definitions. If limy—oo sy, = S (finite), then Definition 4.1.1 implies that (4.1.16)— 
(4.1.19) hold with 5 and s replaced by s. Hence, (4.1.23) follows from the uniqueness of 
s and s. For the converse, suppose that 5 = s and let s denote their common value. Then 
(4.1.16) and (4.1.18) imply that 


S—€<S,<S+€E 


for large n, and (4.1.22) follows from Definition 4.1.1 and the uniqueness of limp—oo Sn 
(Theorem 4.1.2). an] 


190 Chapter 4 Infinite Sequences and Series 


Cauchy’s Convergence Criterion 


To determine from Definition 4.1.1 whether a sequence has a limit, it is necessary to guess 
what the limit is. (This is particularly difficult if the sequence diverges!) To use Theo- 
rem 4.1.12 for this purpose requires finding 5 and s. The following convergence criterion 
has neither of these defects. 


Theorem 4.1.13 (Cauchy’s Convergence Criterion) A sequence {sy} of 
real numbers converges if and only if, for every € > O, there is an integer N such that 


Sn —Sm|<€ if m,n>N. (4.1.24) 
Proof Suppose that limy—oo 5, = s and € > 0. By Definition 4.1.1, there is an integer 


N such that Z 
Isp —sl <5 if r>N. 


Therefore, 
lSn — Sm| = |(Sn — 5) + (8 —Sm)| < [Sn —5| + |5—Sm| <€ if nym>=QN. 


Therefore, the stated condition is necessary for convergence of {s,}. To see that it is suffi- 
cient, we first observe that it implies that {s,} is bounded (Exercise 4.1.27), so ¥ and s are 
finite (Theorem 4.1.9). Now suppose that € > 0 and WN satisfies (4.1.24). From (4.1.16) 
and (4.1.17), 

lSn —S| <€, (4.1.25) 


for some integer n > N and, from (4.1.18) and (4.1.19), 
lSm —S| <€ (4.1.26) 
for some integer m > N. Since 


|s — | = \(S — Sn) + (Sn — Sm) + (Sm —s)| 
< |S —Sn| + [sn — Sm| + [5m — 5], 


(4.1.24)-(4.1.26) imply that 


|s —s| < 3e. 
Since ¢€ is an arbitrary positive number, this implies that 5 = s, so {s,} converges, by 
Theorem 4.1.12. q 
Example 4.1.14 Suppose that 
|f'(x)|<r<1, -oo<x<oo. (4.1.27) 
Show that the equation 


has a unique solution. 
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Solution To see that (4.1.28) cannot have more than one solution, suppose that x = 
F(x) and x’ = f(x’). From (4.1.27) and the mean value theorem (Theorem 2.3.11), 


x—x' = f(x —-x') 
for some c between x and x’. This and (4.1.27) imply that 
|x —x’| <r|x—x'). 


Since r < 1l,x = x’. 
We will now show that (4.1.28) has a solution. With xo arbitrary, define 


Xn = f(%-1), n>. (4.1.29) 
We will show that {x,} converges. From (4.1.29) and the mean value theorem, 
Xn41 —Xn = fXn) — fn-1) = f"(Cn)(%n = Xn-1); 
where cy is between X,—1 and x,. This and (4.1.27) imply that 
IXntt —Xn| <rlXn—Xn-1| if n>. (4.1.30) 


The inequality 
IXn41 —Xn| <r"|x1—xo| if n=O, (4.1.31) 


follows by induction from (4.1.30). Now, ifn > m, 


[Xn — Xm| = (Xn —Xn-1) + (Xn-1 —Xn—2) fees + (Xm+1 —Xm)| 


< [Xn — Xn—1| + |Xn-1 — Xn—2| + +++ + [Xm41 — Xml, 


and (4.1.31) yields 
[Xn —Xm| < [x1 —xolr™t+rt-.-+r7™ 4), (4.1.32) 
In Example 4.1.11 we saw that the sequence {s,} defined by 
se =ltr+--+r* 


converges to 1/(1 —1r) if |r| < 1; moreover, since we have assumed here that 0 <r < 1, 
{s;} is nondecreasing, and therefore s; < 1/(1 —r) forall k. Therefore, (4.1.32) yields 


xy —-x 
Lin — Xm < POL ym if n>m. 
—r 
Now it follows that 
xy —-x 
Lin — xm < ML —0l pw if nsm>QN, 
—r 


and, since limy+oor% = 0, {xn} converges, by Theorem 4.1.13. If © = limy—+oo Xn, then 
(4.1.29) and the continuity of f imply that * = f(x). 
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10. 


11. 


12. 


13. 


4.1 Exercises 


Prove: If s, > 0 forn > k and limy-+o9 Sn = S, then s > 0. 

(a) Show that limy—oo Sn = 5 (finite) if and only if limy—oo |5n — 5| = 0. 

(b) Suppose that |s, —s| < t, for large n and limy+oot, = 0. Show that 
limy-—+o0 Sn = S. 


Find limy-+o0 Sy. Justify your answers from Definition 4.1.1. 


1 a+n 1 ni 
a = 2. b = ——___ c = —gjn — 
(a) Sn 7 at (b) sn Ba (c) Sn ae 
Find limy-+o0 Sn. Justify your answers from Definition 4.1.1. 
n n?+2n+2 
1. — —— 
ka) ss 2n+-Jn+1 (b) sn n>+n 


sinn 
= (d) sp = Vn? +n—n 
n 
State necessary and sufficient conditions on a convergent sequence {s,} such that 
the integer NV in Definition 4.1.1 does not depend upon e. 


Prove: If limy—oo Sy = 5 then limy—+o0 |sn| = |]. 


Suppose that limy—+o0 5, = 8 (finite) and, for each € > 0, |S, — tn| < € for large n. 
Show that lim,-.95 ty = S. 


Complete the proof of Theorem 4.1.6. 


Use Theorem 4.1.6 to show that {s,} converges. 


atn n! 
(a)n= 24" @>o) (b) 9 = 
r” (2n)! 
(c) a i (r > 0) (d) sn = son Gne 


Let y = Tan”! x be the solution of x = tan y such that —1/2 < y < 2/2. Prove: 
If x9 > O and x41; = Tan! xy (n > 0), then {x,} converges. 


Suppose that so and A are positive numbers. Let 


a(=+5) 
Snot =r—lsnt—], n=O. 
2 Sn 


(a) Show that 5,41 > JA ifn > 0. 

(b) Show that 5,41 < sy, ifn > 1. 

(c) Show that s = limp—oo Sn exists. 

(d) Finds. 

Prove: If {s,} is unbounded and monotonic, then either limy—o9 5, = 00 or liMy—+oo Sy = 
—oo. 

Prove Theorem 4.1.7. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 
24. 
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Use Theorem 4.1.7 to find limy+o9 Sy. 
a+tn 
Bn 
(c) sn = nsin— (d) sp =logn—n 


(e€) 5, = log(n + 1) — log(n — 1) 


(a) sn = (B > 0) (b) 5, = cos = 


Suppose that limy—+oo 5, = S (finite). Show that if c is a constant, then limy_.99(c5y) = 


cS. 
Suppose that limy— oo Sn = 5 where s = +oo. Show that if c is a nonzero constant, 


then limy-+o9(C5n) = CS. 


Prove: If limy+99 5, = S and limy-+o99 ty = t, where s and ¢ are finite, then 


lim (sy +f) =s+t and lim (sy —t,) =s—t. 
noo n—->oo 


Prove: If limy+o9 5, = s and limy,+.5t, = t, where s and ¢ are in the extended 
reals, then 

lim (sy +t) =s +t 

n—->oo 


if s + ¢ is defined. 


Suppose that limy—oo tn = t, where 0 < |t| < oo, and let 0 < p < 1. Show that 
there is an integer N such that t, > pt forn > N ift > 0,ort, < pt forn = N if 
t < 0. Ineither case, |t,| > p|t|ifn > N. 
Prove: If noe 

lim — =0, then lim s, =s. 

NO S$, +S n—oo 


HINT: Define tp = (Sn — S)/(Sn + 8) and solve for Sn. 


Prove: if limy—+oo Sn = S and limy-+99 t, = t, where s and ¢ are in the extended 
reals, then 

lim Sytyp = st 

n—->oo 
provided that st is defined in the extended reals. 


Prove: If limy+95 5, = S and limy-+o9 ty = t, then 
lim —=- (A) 


if s/t is defined in the extended reals and t # 0. Give an example where s/t is 
defined in the extended plane, but (A) does not hold. 


Prove Theorem 4.1.9(b). 


Find s and s. 


(a) sn = [(—1)" + 1]n? (b) s, = (1—-r”) sin 
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25. 


26. 


27. 


2n 


(¢) n= (r # -1) (d) s,) =n?—n 
(€) 84 = (—1)"th where limp—sco tn = t 
Find s and s. 

(a) sn = (-1)" (b) 5» = yt (245) 


n+ (-1)"(2n + 1) 
n 


(C) sn = 


Suppose that limy—oo |Sn| = y (finite). Show that {s,} diverges unless y = 0 or the 
terms in {s,} have the same sign for large n. HINT: Use Exercise 4.1.19. 


ni 
d) sp = sin — 
(d) s Baer 


Prove: The sequence {5,} is bounded if, for some positive €, there is an integer N 
such that |s, — 5m| < € whenevern,m > N. 


In Exercises 4.1.28-4.1.31, assume that, s (ors), t, and tare in the extended reals, and 
show that the given inequalities or equations hold whenever their right sides are defined 
(not indeterminate). 


28. 


29. 


30. 


31. 


32. 


33. 


34. 


(a) Jim (mm) = -s (b) lim (5) = 5 
(a) Tim (sn +m) <5+7 (b) lim (s1 +m) >s +2 


(a) If sy = 0, t => 0, then (i) Tim spt, < 57 and (ii) lim spt, > st. 
noo n—>oo 


(b) If sy <0, t, > 0, then (i) lim spt, < Stand (ii) lim spt, > sf. 
ETO: noo 
(a) If lim s, =s > Oandt, > 0,then (i) lim spt, = sfand (ii) lim spt, = st. 
noo noo noo 


(b) If lim s, =s <Oandt, > 0,then (i) lim spt, = stand (ii) lim spt, = sf. 
noo noo 7S 


Suppose that {s,} converges and has only finitely many distinct terms. Show that s, 
is constant for large n. 


Let so and s; be arbitrary, and 


Sn + Sn-1 
Sunt. = — ——,, n=l. 
2 
Use Cauchy’s convergence criterion to show that {s,} converges. 
Sir S2 b+ Sn 
—————, 
n 


Let t, = > 1. 


(a) Prove: If limyoo Sn = § then limy—+oo fn = 5. 
(b) Give an example to show that {z,} may converge even though {s,,} does not. 
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35. (a) Show that 


tin, (1-9) (1-)(- Zao. it a0 


HINT: Look at the logarithm of the absolute value of the product. 
(b) Conclude from (a) that 


lim (1) =» fos <i 
n>oo \n 


where (') is the generalized binomial coefficient of Example 2.5.3. 
n 


4.2 EARLIER TOPICS REVISITED WITH SEQUENCES 


In Chapter 2.3 we used €-6 definitions and arguments to develop the theory of limits, 
continuity, and differentiability; for example, f is continuous at xo if for each « > O there 
isa 6é > 0 such that | f(x) — f(xo)| < € when |x — xo| < 6. The same theory can be 
developed by methods based on sequences. Although we will not carry this out in detail, 
we will develop it enough to give some examples. First, we need another definition about 
sequences. 

Definition 4.2.1 A sequence {t,} is a subsequence of a sequence {s,,} if 

tk = Snes k 2 0, 
where {n;} is an increasing infinite sequence of integers in the domain of {s,}. We denote 


the subsequence {t;} by {5n, }- a 


Note that {s,,} is a subsequence of itself, as can be seen by taking nz = k. All other 
subsequences of {s,} are obtained by deleting terms from {s,} and leaving those remaining 
in their original relative order. 


1 1 1 1 
ns= -—- = | ee ’ 
isn} t= 2 3 n 


then letting n, = 2k yields the subsequence 


ae eee ee 1 
Soaks = Ak = qe greet are ; 


and letting ny, = 2k + 1 yields the subsequence 


Example 4.2.1 If 


Ggot—" Vel 1 7 
Sok+15 = eal = Parts Oke , 
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Since a subsequence {s,,, } is again a sequence (with respect to k), we may ask whether 
{Sn, } converges. 


Example 4.2.2 The sequence {s,} defined by 


Sn = (-1)” (: + ~) 
n 


does not converge, but {s,,} has subsequences that do. For example, 
1 
{Sox} = ! a =z} and jin Sok =1, 


while ; 
ae |e | cee 
{Sox4it aad 


It can be shown (Exercise 4.2.1) that a subsequence {sy, } of {s,} converges to 1 if and 
only if nz is even for k sufficiently large, or to —1 if and only if nz is odd for k sufficiently 
large. Otherwise, {s,, } diverges. a 


and = lim sox4, = —1. 
k—>oo 


The sequence in this example has subsequences that converge to different limits. The 
next theorem shows that if a sequence converges to a finite limit or diverges to too, then 
all its subsequences do also. 


Theorem 4.2.2 If 


lim s, =s (-—coo <s <o), (4.2.1) 
n—->oo 
then 
lim Sp, = 8 (4.2.2) 
k->0oo 


for every subsequence {Sn,} of {Sn}. 


Proof We consider the case where s is finite and leave the rest to you (Exercise 4.2.4). 
If (4.2.1) holds and € > 0, there is an integer NV such that 


lsn —s|<e if n>QN. 


Since {nx} is an increasing sequence, there is an integer K such thatn, > N ifk > K. 
Therefore, 
ln, -LI|<e if k>K, 


which implies (4.2.2). an] 
Theorem 4.2.3 If {s,} is monotonic and has a subsequence {Sn,} such that 
lim sp, =S (-oo<s <ov), 
k->oo 


then 
lim sy, = Ss. 
n—->oo 
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Proof We consider the case where {s,} is nondecreasing and leave the rest to you (Ex- 
ercise 4.2.6). Since {s,, } is also nondecreasing in this case, it suffices to show that 


sup{sn,} = sup{sy} (4.2.3) 


and then apply Theorem 4.1.6(a). Since the set of terms of {s,, } is contained in the set of 
terms of {s,}, 

sup{sn} > sup{Sn, }. (4.2.4) 
Since {s,} is nondecreasing, there is for every n an integer nz such that s, < s,,. This 
implies that 

sup{s,} < sup{sn, }. 
This and (4.2.4) imply (4.2.3). q 


Limit Points in Terms of Sequences 


In Section 1.3 we defined limit point in terms of neighborhoods: X is a limit point of a set 
S' if every neighborhood of X contains points of S' distinct from X. The next theorem shows 
that an equivalent definition can be stated in terms of sequences. 


Theorem 4.2.4 A point X is a limit point of a set S if and only if there is a sequence 
{xn} of points in S such that Xn #X forn > 1, and 


lim x, =X. 
n—->oo 


Proof For sufficiency, suppose that the stated condition holds. Then, for each « > 0, 
there is an integer N such that0 < |x,—x| < €ifn > N. Therefore, every e-neighborhood 
of X contains infinitely many points of S. This means that X is a limit point of S. 


For necessity, let X be a limit point of S. Then, for every integer n > 1, the interval 
(x —1/n,X + 1/n) contains a point x, (# X) in S. Since |x» —X| < 1/nifm > n, 
limy—+o0 Xn = X. an 


We will use the next theorem to show that continuity can be defined in terms of se- 
quences. 


Theorem 4.2.5 
(a) If {xn} is bounded, then {xn} has a convergent subsequence. 
(b) If {xn} is unbounded above, then {xn} has a subsequence {Xp, } such that 


lim Xn, = 00. 
k->0oo 


(c) If {xn} is unbounded below, then {xn} has a subsequence {Xp,} such that 


lim Xn, = —O0o. 
k-0o 
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Proof We prove (a) and leave (b) and (c) to you (Exercise 4.2.7). Let S be the 
set of distinct numbers that occur as terms of {x,}. (For example, if {xn} = {(—1)”}, 
S = {1,1}; if {x} = (1.4,1.4--2,1,1/ne..§ 8 = {lees liad) 1S 
contains only finitely many points, then some X in S occurs infinitely often in {x,}; that is, 
{Xn} has a subsequence {x,, } such that x,, = X forall k. Then limy—oo Xn, = X, and we 


are finished in this case. 


If S is infinite, then, since S is bounded (by assumption), the Bolzano—Weierstrass the- 
orem (Theorem 1.3.8) implies that S has a limit point x. From Theorem 4.2.4, there is a 
sequence of points {y;} in S, distinct from X, such that 


lim y; =¥. (4.2.5) 


Although each y; occurs as a term of {xy}, {yj} is not necessarily a subsequence of {x,}, 
because if we write 

Yj =Xn;; 
there is no reason to expect that {n;} is an increasing sequence as required in Defini- 
tion 4.2.1. However, it is always possible to pick a subsequence {n ;,} of {n;} that is 
increasing, and then the sequence {y;,} = {Sn j, } is a subsequence of both {y;} and {x,}. 
Because of (4.2.5) and Theorem 4.2.2 this subsequence converges to X. 0 


Continuity in Terms of Sequences 
We now show that continuity can be defined and studied in terms of sequences. 


Theorem 4.2.6 Let f be defined on a closed interval [a,b] containing X. Then f is 
continuous at X (from the right if X = a, from the left ifx = b) if and only if 


lim f(X%n) = f() (4.2.6) 
n—-oo 
whenever {xy} is a sequence of points in [a, b] such that 
lim x, =X. (4.2.7) 
n—-oo 


Proof Assume that a < X <b; only minor changes in the proof are needed if ¥ = a or 
x = b. First, suppose that f is continuous at ¥ and {x,} is a sequence of points in [a, b] 
satisfying (4.2.7). If € > 0, there is ad > O such that 


If@—fMl<e if |x-X <6. (4.2.8) 


From (4.2.7), there is an integer N such that |x, —X| < 6ifn > N. This and (4.2.8) 
imply that | f(xn) — f(X)| < € ifn > N. This implies (4.2.6), which shows that the stated 
condition is necessary. 

For sufficiency, suppose that f is discontinuous at x. Then there is an €9 > O such that, 
for each positive integer n, there is a point x, that satisfies the inequality 


_ 1 
|X, —X| < — 
n 
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while 

| f (xn) — f&)| = €0- 
The sequence {x,} therefore satisfies (4.2.7), but not (4.2.6). Hence, the stated condition 
cannot hold if f is discontinuous at X. This proves sufficiency. q 


Armed with the theorems we have proved so far in this section, we could develop the 
theory of continuous functions by means of definitions and proofs based on sequences and 
subsequences. We give one example, a new proof of Theorem 2.2.8, and leave others for 
exercises. 


Theorem 4.2.7 /f f is continuous on a closed interval [a,b], then f is bounded on 
[a, D]. 


Proof The proof is by contradiction. If f is not bounded on [a, b], there is for each 
positive integer n a point x, in [a, b] such that | f(xn)| > 1. This implies that 


jim |fCn)| = 00. (4.2.9) 


Since {xp} is bounded, {x,} has a convergent subsequence {xp, } (Theorem 4.2.5(a)). If 
a ace “ik 
then X is a limit point of [a,b], so X € [a, b]. If f is continuous on [a, b], then 
lim f (xn) = f@®) 

k->0oo 
by Theorem 4.2.6, so 

lim |f(%n,)| = |F@)!| 

k->oo 


(Exercise 4.1.6), which contradicts (4.2.9). Therefore, f cannot be both continuous and 
unbounded on [a, b] q 


4.2 Exercises 


1. Lets, = (-1)"(. + 1/n). Show that limp 51, = 1 if and only if nx is even for 
large k, limg+oo Sn, = —1 if and only if nx is odd for large k, and {s,, } diverges 
otherwise. 

2. Find all numbers L in the extended reals that are limits of some subsequence of {s5, } 
and, for each such L, choose a subsequence {s,, } such that limo 5n, = L. 


(a) 5) = (-1)"n (b) sp = (1 + ~) cos ~ 
1 1 
(6) a= (1-5) sin (d) a 


(e) sn = [(—1)" + 1] n? (fj)s.= —— (sin - + cos =) 
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3. Construct a sequence {s,} with the following property, or show that none exists: for 
each positive integer m, {s,} has a subsequence converging to m. 


4. Complete the proof of Theorem 4.2.2. 

5. Prove: If limy—+oo Sn = s and {s,} has a subsequence {s,,, } such that (-1)* Sn, > 0, 
then s = 0. 

6. Complete the proof of Theorem 4.2.3. 

7. Prove Theorem 4.2.5(b) and (c). 


8. Suppose that {s,} is bounded and all convergent subsequences of {s,} converge to 
the same limit. Show that {s,} is convergent. Give an example showing that the 
conclusion need not hold if {s,} is unbounded. 


9. (a) Let f be defined on a deleted neighborhood N of X. Show that 
lim f(x) =L 
xX 


if and only if limy+o0 f(%n) = L whenever {x,} is a sequence of points in NV 
such that limy—+99 X, = X. HINT: See the proof of Theorem 4.2.6. 
(b) State a result like (a) for one-sided limits. 
10. Give a proof based on sequences for Theorem 2.2.9. HINT: Use Theorems 4.1.6, 
4.2.2, 4.2.5, and 4.2.6. 
11. Give a proof based on sequences for Theorem 2.2.12. 
12. Suppose that f is defined on a deleted neighborhood N of X and {f(xn)} ap- 
proaches a limit whenever {x,} is a sequence of points in N and limy+o Xn = 


x. Show that if {x,} and {y,} are two such sequences, then limy—oo f(%n) = 
limpsoo f (in). Infer from this and Exercise 4.2.9 that lim,.7 f(x) exists. 


13. Prove: If f is defined on a neighborhood N of xX, then / is differentiable at x if and 


only if 
im Lo — fC) 
im —W— 
n—>oo Xn —-X 
exists whenever {x,,} is a sequence of pointsin N such that x, 4 X and lim, Xn = 
xX. HINT: Use Exercise 4.2.12. 


4.3 INFINITE SERIES OF CONSTANTS 


The theory of sequences developed in the last two sections can be combined with the fa- 
miliar notion of a finite sum to produce the theory of infinite series. We begin the study of 
infinite series in this section. 


Definition 4.3.1 If {a,}?° is an infinite sequence of real numbers, the symbol 


es) 
dan 
n=k 
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is an infinite series, and dy is the nth term of the series. We say that pas An converges to 


the sum A, and write 
Co 
y an = A, 
n=k 
if the sequence { A, }?° defined by 


An = ak + 4x41 +++ +n, n=k, 


converges to A. The finite sum A, is the nth partial sum of Y~y-_, an. If {An }e diverges, 
CO . . . . . 
we say that pek dy diverges; in particular, if limp An = OO or —0o, we say that 


yg an diverges to oo or —oo, and write 


lo) lore) 
y an =O or ) an = —0O 
n=k n=k 


A divergent infinite series that does not diverge to oo is said to oscillate, or be oscillatory. 


We will usually refer to infinite series more briefly as series. 


Example 4.3.1 Consider the series 


1— pti 


aa i 
, f=, -l<r<l. 
r 


If |r 


> 1, then (4.3.1) is still valid, but el r” diverges; if r > 1, then 


(4.3.1) 


(4.3.2) 


while if r < —1, )°°29r” oscillates, since its partial sums alternate in sign and their 
magnitudes become arbitrarily large for large n. If r = —1, then Azy+4, = Oand Az, = 1 
form > 0, while ifr = 1, An =n + 1; in both cases the series diverges, and (4.3.2) holds 


ifr =1. 
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The series )°-_9 r” is called the geometric series with ratio r. Tt occurs in many appli- 
cations. 


An infinite series can be viewed as a generalization of a finite sum 


N 
A= So an = a4 + dey, +++ +4N 
n=k 


by thinking of the finite sequence {a,, ax41,...,an} as being extended to an infinite se- 
quence {dp }7° with a, = 0 forn > N. Then the partial sums of > Gn ate 
An =e + 4x41 t+: +an, k<n<QN, 
and 
An =A, n>QN; 

that is, the terms of {Ay We equal the finite sum A forn > k. Therefore, limy—oo An 
=A. 

The next two theorems can be proved by applying Theorems 4.1.2 and 4.1.8 to the partial 
sums of the series in question (Exercises 4.3.1 and 4.3.2). 


Theorem 4.3.2 The sum of a convergent series is unique. 


Theorem 4.3.3 Let 


[o.@) CO 
>" an =A and ae = B, 
=k =k 
where A and B are finite. Then 
[o,@) 
Y- (can) =cA 
=k 


if c is a constant, 
[oe 


Yan + bn) = AFB, 

n=k 
and 

Co 

"Gn — bn) = A-B. 

n=k 
These relations also hold if one or both of A and B is infinite, provided that the right sides 
are not indeterminate. 


Dropping finitely many terms from a series does not alter convergence or divergence, 
although it does change the sum of a convergent series if the terms dropped have a nonzero 
sum. For example, suppose that we drop the first k terms of a series °° 9 dn, and consider 
the new series }“>-_, dn. Denote the partial sums of the two series by 

An =d9 +, +---+4n, n=O, 
and 
Al =ap + aegi te: tan, n=k. 
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Since 
An = (490 +a, +-++ + 4x1) +A), n>k, 


it follows that A = limy—oo An exists (in the extended reals) if and only if A’ = limy— oo Aj, 
does, and in this case 


A= (ao +41 +++++ag-1) + A’. 


An important principle follows from this. 


Lemma 4.3.4 Suppose that for n sufficiently large (that is, forn > some integer N) 
the terms of ¥--°_, an satisfy some condition that implies convergence of an infinite series. 
Then \--~_, dn converges. Similarly, suppose that for n sufficiently large the terms \-?-_;, An 
satisfy some condition that implies divergence of an infinite series. Then )-°-_, dn diverges. 


Example 4.3.2 Consider the alternating series test, which we will establish later as a 
special case of a more general test: 


The series . dn converges if (—1)"an > 0, |dn+1| < |dn|, and limyp+oo dn = 0. 


The terms of 
le. ) 


16 + (-2)" 
= 


n2” 
n=1 


do not satisfy these conditions for all > 1, but they do satisfy them for sufficiently large 
n. Hence, the series converges, by Lemma 4.3.4. |_| 


We will soon give several conditions concerning convergence of a series )--_, dn with 
nonnegative terms. According to Lemma 4.3.4, these results apply to series that have at 
most finitely many negative terms, as long as dy is nonnegative and satisfies the conditions 
for 1 sufficiently large. 


When we are interested only in whether )°°2_; an converges or diverges and not in its 
sum, we will simply say “}> a, converges” or “) > dy diverges.” Lemma 4.3.4 justifies 
this convention, subject to the understanding that )> a stands for YS % an, where k is an 
integer such that a, is defined for n > k. (For example, 


CO 


1 1 
>. @@—62 stands for > @—6?’ 


n=k 


where k > 7.) We write )° a, = co (—oo) if > ay diverges to oo (—oo). Finally, let us 
agree that 
[o) Co 
> dn and s; An+j 
n=k n=k—j 
(where we obtain the second expression by shifting the index in the first) both represent the 


same series. 
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Cauchy’s Convergence Criterion for Series 


The Cauchy convergence criterion for sequences (Theorem 4.1.13) yields a useful criterion 
for convergence of series. 


Theorem 4.3.5 (Cauchy’s Convergence Criterion for Series) A series 
>" an converges if and only if for every € > 0 there is an integer N such that 


lan +Ont41 +---+am|<e if m>n>N. (4.3.3) 
Proof In terms of the partial sums {A,} of }> an, 
An + Gnt1 +°++ +m = Am — An-1- 
Therefore, (4.3.3) can be written as 
|Am —An-1|<e€ if m>n=>N. 


Since }° a, converges if and only if {A,} converges, Theorem 4.1.13 implies the conclu- 
sion. q 


Intuitively, Theorem 4.3.5 means that )> ay converges if and only if arbitrarily long sums 
Aan + Qn41 ++:-+dm, M=N, 


can be made as small as we please by picking n large enough. 


Example 4.3.3 Consider the geometric series )> r” of Example 4.3.1. If |r| => 1, then 
{r”} does not converge to zero. Therefore }*r” diverges, as we saw in Example 4.3.1. If 
Ir| < 1 and m > n, then 


|Am — An| = [r"tt + r™4? 4... 4 7™| 


< n+l 1 Ev m—n-—-1 
< (Ph ree ber) ere 
- 1 
= peti : < ial ‘ 
T=] T= |r| 
If « > 0, choose N so that 
a baa 
€. 
LF 
Then (4.3.4) implies that 
[Amn —An|<e if m>n>N. 
Now Theorem 4.3.5 implies that }*r” converges if |r| < 1, as in Example 4.3.1. a 


Letting m = n in (4.3.3) yields the following important corollary of Theorem 4.3.5. 


Corollary 4.3.6 If }° ay converges, then limp—oo An = 0. 
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It must be emphasized that Corollary 4.3.6 gives a necessary condition for convergence; 
that is, )> dy» cannot converge unless limy—oo dn = 0. The condition is not sufficient; }° an 
may diverge even if limy—oo dn = 0. We will see examples below. 


We leave the proof of the following corollary of Theorem 4.3.5 to you (Exercise 4.3.5). 


Corollary 4.3.7 If }° a, converges, then for each « > 0 there is an integer K such 
that 


CO 
Yo an <e if k>K; 
re 
that is, 
[oe 
jim dan = 0 


Example 4.3.4 If |r| < 1, then 


oo lee) oo Ir|* 
k n—-k k n 
r’| = Ir r = |r | — 
3 De ee 
n=k n=k n=0 
Therefore, if 
al 
<e€ 
l-r 
then 
<e if k>K, 


os) 
ye 
n=k 


which implies that limg—oo )-72, r” = 0. 


Series of Nonnegative Terms 


The theory of series }* a, with terms that are nonnegative for sufficiently large n is simpler 
than the general theory, since such a series either converges to a finite limit or diverges to 
oo, as the next theorem shows. 


Theorem 4.3.8 Ifa, > 0 forn > k, then Yay converges if its partial sums are 
bounded, or diverges to 00 if they are not. These are the only possibilities and, in either 
case, 


where 
An =p + ak41 ++: +an, n=k. 
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Proof Since A, = An—1 +n and dy > 0 (n > k), the sequence {A,} is nondecreasing, 
so the conclusion follows from Theorem 4.1.6(a) and Definition 4.3.1. 
q 
If a, = 0 for sufficiently large n, we will write )° ay < 00 if )° a, converges. This con- 
vention is based on Theorem 4.3.8, which says that such a series diverges only if )> dn = 
oo. The convention does not apply to series with infinitely many negative terms, because 
such series may diverge without diverging to oo; for example, the series )\7°_)(—1)” os- 
cillates, since its partial sums are alternately | and 0. 


Theorem 4.3.9 (The Comparison Test) Suppose that 
O0<a, <bn, n>k. (4.3.5) 


Then 
(a) ian < if bn < &. 
(Bb): Sb, = cof ¥ ag = 00. 


Proof (a) If 
An = Ap +dg4, t-+- +a, and By, = by +bheay t---t+bn, n=k, 


then, from (4.3.5), 
An < Bn. (4.3.6) 


Now we use Theorem 4.3.8. If }> by < 00, then {B,} is bounded above and (4.3.6) implies 
that {A,,} is also; therefore, )> a, < oo. On the other hand, if )° a, = co, then {Ay} is 
unbounded above and (4.3.6) implies that { B,} is also; therefore, }* by = 00. 


We leave it to you to show that (a) implies (b). au 


Example 4.3.5 Since 

r n 

—<r", n=l, 

n 
and )>r” < coif0 <r <1, theseries )> r”/n converges if 0 < r < 1, by the comparison 
test. Comparing these two series is inconclusive if r > 1, since it does not help to know 
that the terms of )> r”/n are smaller than those of the divergent series )" rr”. If r < 0, the 
comparison test does not apply, since the series then have infinitely many negative terms. 


Example 4.3.6 Since 

r” <nr" 
and }*r” = oo if r > 1, the comparison test implies that )> nr” = oo if r > 1. Compar- 
ing these two series is inconclusive if 0 < r < 1, since it does not help to know that the 
terms of }’nr” are larger than those of the convergent series )° r”. a 
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The comparison test is useful if we have a collection of series with nonnegative terms 
and known convergence properties. We will now use the comparison test to build such a 
collection. 


Theorem 4.3.10 (The Integral Test) Let 


Cn = f(n), n = k, (4.3.7) 
where f is positive, nonincreasing, and locally integrable on [k, 00). Then 
>on < 00 (4.3.8) 
if and only if 
Co 
i: f(x) dx < oo. (4.3.9) 
k 
Proof We first observe that (4.3.9) holds if and only if 
oO n+1 
> f(x) dx <0 (4.3.10) 
n=k°" 


(Exercise 4.3.9), so itis enough to show that (4.3.8) holds if and only if (4.3.10) does. From 
(4.3.7) and the assumption that f is nonincreasing, 


cn41 = f+ )D<f@)sf@M=en, nxx<ntl, n=k. 


Therefore, 


n+1 n+1 n+1 
cust = f cnsidx sf fede s | Cnhdx =Cn, n=>k 
n n n 


(Theorem 3.3.4). From the first inequality and Theorem 4.3.9(a) with dy, = Cn+1 and 
by = eae F(x) dx, (4.3.10) implies that )° cn+1 < 00, which is equivalent to (4.3.8). 
From the second inequality and Theorem 4.3.9(a) with a, = ae F(x) dx and by = ¢n, 
(4.3.8) implies (4.3.10). aa 


Example 4.3.7 The integral test implies that the series 


1 1 1 
—, ——_., d ——_—__—__—_{ 
Ss nP a n(logn)? oe x n logn [log(log n)]|? 


converge if p > 1 and diverge if 0 < p < 1, because the same is true of the integrals 


[ dx [ dx F a dx 
a xP? Jy x(logx)?’ a xXlogx [log(log x)]? 


if a is sufficiently large. (See Example 3.4.3 and Exercise 3.4.10.) The three series di- 
verge if p < 0: the first by Corollary 4.3.6, the second by comparison with the divergent 
series )* 1/n, and the third by comparison with the divergent series )> 1/(n logn). (The 
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divergence of the last two series for p < 0 also follows from the integral test, but the 
divergence of the first does not. Why not?) These results can be generalized: If 


Lo(x) =x and Ly(x) =loglLeaQ)], k= 1, 


then 
‘ 1 
Lo(n)Li(n)- +: Le(n)[Livi 
converges if and only if p > 1 (Exercise 4.3.11). | 


This example provides an infinite family of series with known convergence properties 
that can be used as standards for the comparison test. 


Except for the series of Example 4.3.7, the integral test is of limited practical value, 
since convergence or divergence of most of the series to which it can be applied can be 
determined by simpler tests that do not require integration. However, the method used to 
prove the integral test is often useful for estimating the rate of convergence or divergence 
of a series. This idea is developed in Exercises 4.3.13 and 4.3.14. 


Example 4.3.8 The series 


- 1 

———— 4.3.11 
Birra (4.3.11) 
converges if g > 1/2, by comparison with the convergent series )> 1/n4, since 


1 1 


Wine +n < ori n> 1. 


This comparison is inconclusive if g < 1/2, since then 


1 
ay = 
and it does not help to know that the terms of (4.3.11) are smaller than those of a divergent 
series. However, we can use the comparison test here, after a little trickery. We observe 
that 
lo 2) 1 le, ) 


1 
2 eae ee 
rile re aes 


and 
1 1 


—_——- < —>——. 
(n+1)?4 9 (n2?+n)4 
Therefore, the comparison test implies that 


1 
———_ =o, < 1/2. i 
Vaepr 9S4/ 
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The next theorem is often applicable where the integral test is not. It does not require the 
kind of trickery that we used in Example 4.3.8. 


Theorem 4.3.11 Suppose that an > 0 and by > 0 forn > k. Then 
(a) Yo an <oo if So bn <oo and tim dn /bn < 00. 


(b) Y > dn = 00 if > fn = 00 and lim an/bn > 0. 


noo 


Proof (a) If limp—+co dn/bn < 00, then {an /bn} is bounded, so there is a constant M 
and an integer k such that 
an <Mbn, n>k. 


Since }* by < oo, Theorem 4.3.3 implies that )*(Mbn) < 00. Now }\ dyn < 00, by the 
comparison test. 


(b) If lim, 5 dn/bn > 0, there is a constant m and an integer k such that 


an >mby, n>k. 


Since }* by = oo, Theorem 4.3.3 implies that )>(mbn) = 00. Now > dy = on, by the 
comparison test. 0 


Example 4.3.9 Let 


i 2+ sinnz/6 
SS bs = a nPt4 and dian ~ LG Pe DF 


Then 
dn _ 2+ sinnz/6 
by = (1 +1/n)P(1—1/n)9 
SO — a ii 
lim —=3 and lim “=1. 
noo by noo On 


Since )° by < oo if and only if p + q > 1, the same is true of }° a, by Theorem 4.3.11. 
a 


The following corollary of Theorem 4.3.11 is often useful, although it does not apply to 
the series of Example 4.3.9. 


Corollary 4.3.12 Suppose that ay, > 0 and by > 0 forn > k, and 


li 


n 
im —=L, 
noo Dy 


where 0 < L < oo. Then Y- ay and )* by converge or diverge together. 
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Example 4.3.10 With this corollary we can avoid the kind of trickery used in the 
second part of Example 4.3.8, since 


1 1 
fi a oe i 
Rasen (n2 + n)d |x Pires ad + 1/n)4 
1 1 
> (2 +n)? a ny and > 724 


converge or diverge together. 


= 1, 


sO 


The Ratio Test 


It is sometimes possible to determine whether a series with positive terms converges by 
comparing the ratios of successive terms with the corresponding ratios of a series known to 
converge or diverge. 


Theorem 4.3.13 Suppose that an > 0, bn > 0, and 


ee (4.3.12) 
Then 
(a), ¥ on SeeT Y ty = 00: 
(b) 3b; =coif a, = oc. 
Proof Rewriting (4.3.12) as 
an+1 Z an 
Vpn Das 


we see that {a,, /by} is nonincreasing. Therefore, limn—soo dn/bn < 00, and Theorem 4.3.11 (a) 
implies (a). 

To prove (b), suppose that }°a, = oo. Since {ay/bn} is nonincreasing, there is a 
number p such that b, > pay for large n. Since (pan) = 00 if )° ay = ov, Theo- 
rem 4.3.9(b) (with a, replaced by pay) implies that )* b, = 00. an 

We will use this theorem to obtain two other widely applicable tests: the ratio test and 
Raabe’s test. 


Theorem 4.3.14 (The Ratio Test) Suppose that an > 0 forn => k. Then 


(a) Ya, S00 F lites Gn /an <1. 
(b) Yan = wif lim, ,.54n+1/dn > 1. 


If 
an+1 


Fath 22 Tim (4.3.13) 


n>oo dn n—>coo Ay 


then the test is inconclusive; that is, )- ay may converge or diverge. 
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Proof (a) If 
—— a4n+1 
lim —— 


n>OO Ay 


<i, 


there is a number r such that 0 < r < | and 


an+1 
an 


<r 


for 1 sufficiently large. This can be rewritten as 


an+1 pe 


an rn 


Since )>r” < oo, Theorem 4.3.13(a) with b, = r” implies that )* an < 00. 
(b) If 


there is a number r such that r > 1 and 


an+1 
an 


> 


for n sufficiently large. This can be rewritten as 


an+1 pore 
> 


dn rn 


Since )>r” = oo, Theorem 4.3.13(b) with a, = r” implies that )* by = ov. 
To see that no conclusion can be drawn if (4.3.13) holds, consider 
_ 1 
LS De 
This series converges if p > 1 or diverges if p < 1; however, 
= 4n+1 : an+1 
= lm 


lim 
n—->oo an n—oo an 


=1 


for every p. 


Example 4.3.11 If 


Sian => (2+ sin) r”, 


then 
_ (nt+il)ar 
ici. 2+ sin >—— 
an = Det pee 
2 


which assumes the values 37/2, 2r/3, r/2, and 2r, each infinitely many times; hence, 


lim — =2r and lim —= -. 


211 


Therefore, )> dy converges if 0 < r < 1/2 and diverges if r > 2. The ratio test is 


inconclusive if 1/2 < r < 2. 


212 Chapter 4 Infinite Sequences and Series 


The following corollary of the ratio test is the familiar ratio rest from calculus. 


Corollary 4.3.15 Suppose that a, > 0(n =k) and 


Then 
(a) ian < coifL <1. 
(b) Sa, = coh > 1. 


The test is inconclusive if L = 1. 


Example 4.3.12 The series )> a, = )o nr”! converges if 0 <r < 1 or diverges if 


r > 1, since 
1)r” 1 
Ba cc METI asd 4 ag, 
an nr?-l n 
so 


Corollary 4.3.15 is inconclusive if r = 1, but then Corollary 4.3.6 implies that the series 
diverges. | 
The ratio test does not imply that )> a, < oo if merely 


an+1 
an 


<1 (4.3.14) 


for large n, since this could occur with limy— oo Gn41/dn = 1, in which case the test is 
inconclusive. However, the next theorem shows that }° dy < oo if (4.3.14) is replaced by 


the stronger condition that 
P 


an+1 <] 
an n 


for some p > 1 and large n. It also shows that )° a, = 00 if 
Gn+1 >1-— us 
an n 


for some q < | and large n. 


Theorem 4.3.16 (Raabe’s Test) Suppose that an > 0 for large n. Let 


M= Tim,» (#1) and m= lim » (2-1). 
TOO an noo an 
Then 
(a) ian < oifM <-l. 
(b) Sian = coifm>-—l. 


The test is inconclusive ifm < —1 < M. 
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Proof (a) We need the inequality 
This follows from Taylor’s theorem (Theorem 2.5.4), which implies that 


(1+ x)? 2A +c)Pt2™ ? 
where 0 < c < x. (Verify.) Since the last term is positive if p > 0, this implies (4.3.15). 


Now suppose that M < —p < —1. Then there is an integer k such that 


an 
so : p 
n+1 
1--, n>k 
an n 
Hence, 
an+1 1 


—— < ——_.,_ n> k, 
an (1 + 1/n)P 


as can be seen by letting x = 1/n in (4.3.15). From this, 


1 1 
Gn+1 < —, n = k. 
an (n+ 1)? / n? 


Since }°1/n? < oo if p > 1, Theorem 4.3.13(a) implies that )* an < oo. 
(b) Here we need the inequality 


(l—x)? <l-qx, O0<x<1, 0<q<l. (4.3.16) 


This also follows from Taylor’s theorem, which implies that 


2 
(1x) = 1-gxt+qq- 0-0), 


where 0 <c <x. 
Now suppose that —1 < —q < m. Then there is an integer k such that 
n (4-1) >-q, n=k, 
an 
so 


Orth ow n>k. 


—_ ’ 


an n 
If gq < 0, then }> ay, = 00, by Corollary 4.3.6. Hence, we may assume that 0 < q < 1, so 
the last inequality implies that 
1 q 
“it 5 (1--) , n>k, 


an n 
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as can be seen by setting x = 1/n in (4.3.16). Hence, 


1 1 
last > — / ——, nek. 
an nif (n—1)4 


Since )- 1/n4 = 00 if gq < 1, Theorem 4.3.13(b) implies that }* a, = oo. an 


Example 4.3.13 If 


n! 
an = —_————,, a > 0, 
De . 2] =e =e 
then ; 
eS ee ag, 
n>oo An n>oa+n 
so the ratio test is inconclusive. However, 
1 
lim n (“= - i) = lim n (: = i) 
n—>oo an n—>oo a+n 
n(l—a@) 
= =l-a, 


so Raabe’s test implies that )> dy < 00 ifa > 2 and }’an = oo if0 <a < 2. Raabe’s 
test is inconclusive if ~@ = 2, but then the series becomes 


n! 1 
Svea Sak 


which we know is divergent. 


Example 4.3.14 Consider the series }° a,, where 
(m!)? 

Op FS oS SDD DELS oo 

om (a + 1) +++ (e+ m)B(B + 1)---(B +m) 


and 
- (m!)2(m +1) 
(amt) = Vath @+mBpB+l--(btm+l) 


with 0 <a < B. Since 
1 2 
2m (ett 1) — 3m (PEE 1) = OP 
d2m B+m+l1 B+m+1 


" 1 2 1 
Get il 4 | =onaty Sa See 
dom+1 atm+l atm+1l 


and 


we have 


lim n (= — 1) =-—2a and limn (= - 1) = —26. 


an an 


Raabe’s test implies that )* dn < oo ifa@ > 1/2 and }° a, = oo if B < 1/2. The test is 
inconclusive if0 <a <1/2< fB. a 
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The next theorem, which will be useful when we study power series (Section 4.5), con- 
cludes our discussion of series with nonnegative terms. 


Theorem 4.3.17 (Cauchy’s Root Test) Ifa, > 0 forn > k, then 
(a) Yldn < 00 if lin sco an!” <1. 

(b) oan = 0 iflimp+oo al!” >1. 

The test is inconclusive if liMp—+o0 all® = 1. 

Proof (a) If limp—oo al!” < 1, there is an r such that 0 <r < 1 anda)!” <r for 
large n. Therefore, a, <r” for large n. Since )> r” < 00, the comparison test implies that 
Yodan < 00. 


(b) If limp—oo al!” > 1, then al/” > 1 for infinitely many values of n, so )> dy = 00, 
by Corollary 4.3.6. q 


Example 4.3.15 Cauchy’s root test is inconclusive if 


ya = = 


because then 


1/n 
lim a, = lim (—) = lim exp (—4 logn) =1 
noo n—>oo \ nP noo n 
for all p. However, we know from the integral test that > 1/n? < oo if p > 1 and 
Yi l/n? = wif p <1. 


Example 4.3.16 If 
Yo an = 2 (2 + sin ) r”, 


—— — ni 
ime? S im (2 + sin =) pai 


then 


n—->oo n—-oo 


and so )\a, < oo ifr < 1/3 and oa, = coifr > 1/3. The test is inconclusive if 
r = 1/3, but then |agm42| = 1 form > 0,80 }° ay = oo, by Corollary 4.3.6. 
Absolute and Conditional Convergence 


We now drop the assumption that the terms of )* a, are nonnegative for large n. In this 
case, ) dy may converge in two quite different ways. The first is defined as follows. 


Definition 4.3.18 A series )° ay converges absolutely, or is absolutely convergent, if 
Y |an| < 00. 
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Example 4.3.17 A convergent series }~° a, of nonnegative terms is absolutely conver- 
gent, since )> dm and >> |ay| are the same. More generally, any convergent series whose 
terms are of the same sign for sufficiently large n converges absolutely (Exercise 4.3.22). 


Example 4.3.18 Consider the series 


sinnd 
> ’ (4.3.17) 


where @ is arbitrary and p > 1. Since 


nP “~ nP 


a 1 
< 


and )°1/n? < oo if p > 1, the comparison test implies that 


Xe 


Therefore, (4.3.17) converges absolutely if p > 1. 


sinnd 


nP 


|< oo, p>. 


Example 4.3.19 If 0 < p <1, then the series 


1)" 
pa er 


does not converge absolutely, since 
1 


(=1 
LF |-oo-~ 


However, the series converges, by the alternating series test, which we prove below. | 


Any test for convergence of a series with nonnegative terms can be used to test an arbi- 
trary series )* a, for absolute convergence by applying it to )> |ay|. We used the compar- 
ison test this way in Examples 4.3.18 and 4.3.19. 


Example 4.3.20 To test the series 


7 n!} 
dian ae i! a(a+1)---(a+tn—1)’ aia 


for absolute convergence, we apply Raabe’s test to 


n!} 
La eed Gta). 


From Example 4.3.13, > |an| < oo ifa@ > 2 and > |an| = co ifaw < 2. Therefore, }° ay 
converges absolutely if a > 2, but not if @ < 2. Notice that this does not imply that }° a, 
diverges ifa < 2. | 
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The proof of the next theorem is analogous to the proof of Theorem 3.4.9. We leave it to 
you (Exercise 4.3.24). 


Theorem 4.3.19 If }° a, converges absolutely, then )~ dy converges. 
For example, Theorem 4.3.19 implies that 
y sinnd 
nP 


converges if p > 1, since it then converges absolutely (Example 4.3.18). 


The converse of Theorem 4.3.19 is false; a series may converge without converging abso- 
lutely. We say then that the series converges conditionally, or is conditionally convergent; 
thus, )°(—1)”/n? converges conditionally if0 < p < 1. 


Dirichlet’s Test for Series 


Except for Theorem 4.3.5 and Corollary 4.3.6, the convergence tests we have studied so 
far apply only to series whose terms have the same sign for large n. The following theo- 
rem does not require this. It is analogous to Dirichlet’s test for improper integrals (Theo- 
rem 3.4.10). 


Theorem 4.3.20 (Dirichlet’s Test for Series) The series ~?-, dnbn con- 
verges if liMyp—+oo dn = 0, 


Y > |an+1 — an| < 00, (4.3.18) 


and 
lobe + bggpt-:-+bn| <M, n>=k, (4.3.19) 


for some constant M. 
Proof The proof is similar to the proof of Dirichlet’s test for integrals. Define 
Bn = be + begi +--+: thn, n=&k 

and consider the partial sums of )77¢ dnbn: 

Sn = agbe + agp beer + e++ + anbn, n=k. (4.3.20) 
By substituting 

by = Be and by = By,—Bn-1, n>=k+1, 
into (4.3.20), we obtain 

Sn = a¢ By + ak41(Br+i — Be) +++++4n(Bn — Bn-1), 

which we rewrite as 


Sn = (Ak — Ak41) Be + (Ak41 — Gk42) Bei te: 


4.3.21 
+ (an—1 — An) Bn—1 + Gn Bn. ( ) 
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(The procedure that led from (4.3.20) to (4.3.21) is called summation by parts. It is analo- 
gous to integration by parts.) Now (4.3.21) can be viewed as 


Sn = Tn-1 + Gn Bn, (4.3.22) 
where 
Th-1 = (dk — O41) Be + (Gkt1 — Ak42)Besi +++ + Gn-1 — Gn) Bn-1; 
that is, {7,,} is the sequence of partial sums of the series 
00 
do Gy — 4541) B;. (4.3.23) 
jak 


Since 
(aj —aj41)Bj| < Mla; —aj41| 


from (4.3.19), the comparison test and (4.3.18) imply that the series (4.3.23) converges 
absolutely. Theorem 4.3.19 now implies that {7} converges. Let T = limp—+oo Tn. Since 
{B,} is bounded and lim,-.55 dn = 0, we infer from (4.3.22) that 


lim S, = lim 7Ty-; + lim a,B, = T+0=T. 
noo noo noo 


Therefore, )> dnbn converges. an 


Example 4.3.21 To apply Dirichlet’s test to 


> ae O0#knx (k = integer), 


er tae Goad 
we take ; 
an = n+(-l* and bn = sinné. 
Then limy-+o9 dn = O, and 
3 
lan41 —4n| < n(n —1) 


(verify), so 
ldn41 —an| < 00. 
Now 
Bn = sin26 + sin36 +---+ sinné. 


To show that {B,,} is bounded, we use the trigonometric identity 


cos (r — 4) 6 —cos (r + 4) 6 


eo 
smd 2 sin(0/2) 


, O#2kn, 
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to write 
__ (cos 30 — cos $6) + (cos 36 — cos 56) ferret (cos (n - s) 6 —cos(n + $)0) 
ca 2 sin(0/2) 
_ COS 30 —cos(n + $)0 
2 sin(0/2) 
which implies that 
1 
B,| < |\——= |, >2 
Bul < sin(6/2) oe 


Since {a,} and {by} satisfy the hypotheses of Dirichlet’s theorem, )* ann converges. Ml 
Dirichlet’s test takes a simpler form if {a,} is nonincreasing, as follows. 


Corollary 4.3.21 (Abel’s Test) The series )° anbn converges if an41 < an for 


n> k, limy-+o9 dn = 0, and 
lbe toegr te: thn] <M, n=>k, 


for some constant M. 


Proof If aj41 < dp, then 


m m 


Yo lant — an| = }5 Gn — ant1) = ae — m4. 


n=k n=k 
Since limm—+o0 dm+1 = 0, it follows that 


CoO 


Y= lan+1 — an| = ay < 00. 
n=k 
Therefore, the hypotheses of Dirichlet’s test are satisfied, so }~ a,b, converges. 0 


Example 4.3.22 The series 


sinné 
» np’ 
which we know is convergent if p > 1 (Example 4.3.18), also converges if 0 < p < 1. 
This follows from Abel’s test, with a, = 1/n? and by, = sinn (see Example 4.3.21). i 


The alternating series test from calculus follows easily from Abel’s test. 


Corollary 4.3.22 (Alternating Series Test) The series )\(—1)" an converges 
if0 < Andi < an and limp+o0 An = 0. 
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Proof Let b, = (—1)"; then {|B,|} is a sequence of zeros and ones and therefore 
bounded. The conclusion now follows from Abel’s test. 0 


Grouping Terms in a Series 


The terms of a finite sum can be grouped by inserting parentheses arbitrarily. For example, 
(+7)+(6+5)+4=0474+64+(6+4 =0+7)+(4+5+4). 


According to the next theorem, the same is true of an infinite series that converges or 
diverges to =-Eoo. 


Theorem 4.3.23 Suppose that -7-4dn = A, where —o0 < A < oo. Let {nj }$° be 
an increasing sequence of integers, withn, > k. Define 


by = ag t+ +n, 
bz = Gny41 t+++ + Gn, 


by = An,_, +1 +t + an,. 


Then 


Proof If 7; is the rth partial sum of ae bn, and {Ay} is the nth partial sum of 
yee as, then 
T, = by + bz +++ +b, 
= (G1 22+ Gay) (Gay hi Ft Gag) Ee Fe (Gap pe P e2 ae, ) 
= An,. 
Thus, {7;} is a subsequence of {A,,}, so limp+o9 Ty = limy+oo An = A by Theorem 4.2.2. 
aa 


Example 4.3.23 If )°°2.)(—1)"4an satisfies the hypotheses of the alternating series 
test and converges to the sum S, Theorem 4.3.23 enables us to write 


k love) 
S = )°C1)"an + (-1)**" 9) Ge42j-1 — ae 42;) 


n=0 j=l 
and k oo 
S= OCD" an + (-1)**" | agai - YS) Ge+2; — Ak+2j-1) |. 
n=0 j=l 
Since 0 < adn+41 < dn, these two equations imply that S—S; is between 0 and (1) apa: 
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Example 4.3.24 Introducing parentheses in some divergent series can yield seem- 
ingly contradictory results. For example, it is tempting to write 


Yoep"t = -1)+0-)+---=04+04--- 


n=1 


and conclude that }°P°_,(—1)” = 0, but equally tempting to write 


yeep" =1-(-1I)-d-)--- 


n=1 


=1=0=§=s2 


and conclude that ye (-1)"*1 = 1. Of course, there is no contradiction here, since 
Theorem 4.3.23 does not apply to this series, and neither of these operations is legitimate. 


Rearrangement of Series 
A finite sum is not changed by rearranging its terms; thus, 
14-347=1474+3=34147=34741=7414+3=74+341. 


This is not true of all infinite series. Let us say that )7 by is a rearrangement of )° ay if 
the two series have the same terms, written in possibly different orders. Since the partial 
sums of the two series may form entirely different sequences, there is no apparent reason 
to expect them to exhibit the same convergence properties, and in general they do not. 


We are interested in what happens if we rearrange the terms of a convergent series. We 
will see that every rearrangement of an absolutely convergent series has the same sum, but 
that conditionally convergent series fail, spectacularly, to have this property. 


Theorem 4.3.24 If )°°°., bn is a rearrangement of an absolutely convergent series 
een An, then ea by also converges absolutely, and to the same sum. 


Proof Let 
An = |a1| +la2|+-+:+ an] and By = |bi| + |b2| +--+ + |dal. 


For each n > 1, there is an integer Ky such that by, bo, aon bn are included among a1, a2, 
w+, Ak,» $0 By < Ax,. Since {Ay} is bounded, so is {By}, and therefore }* |b | < co 
(Theorem 4.3.8). 


Now let 


An =Q, +02 +-++-+an, Bn =b) +bo4+---+)dn, 


[oe lo, ) 
A=) an, and B=). be 
n=1 n=1 
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We must show that A = B. Suppose that « > 0. From Cauchy’s convergence criterion for 
series and the absolute convergence of }° dy, there is an integer N such that 


lan4i| + |ang2| +--+ lawae| <e, k> 1. 


Choose N; so that a1, a2, ..., ay are included among by, bo, ..., by,. Ifn > M1, 
then A, and B, both include the terms aj, a2, ..., ay, which cancel on subtraction; thus, 
|A, —B,| is dominated by the sum of the absolute values of finitely many terms from )° a, 
with subscripts greater than N. Since every such sum is less than e€, 


|A,-—Brl<e if n>WMj. 
Therefore, limyp—+o0(An — By) = 0 and A = B. an 


To investigate the consequences of rearranging a conditionally convergent series, we 
need the next theorem, which is itself important. 


Theorem 4.3.25 If P = {dn;}{° and Q = {am ,}{° are respectively the subsequences 
of all positive and negative terms in a conditionally convergent series )\ an, then 


lo, [oe 
Sdn, =00 and Y\ am, = —00. (4.3.24) 


i=1 J=1 


Proof If both series in (4.3.24) converge, then )* a, converges absolutely, while if one 
converges and the other diverges, then )* a, diverges to co or —oo. Hence, both must 
diverge. aa) 


The next theorem implies that a conditionally convergent series can be rearranged to 
produce a series that converges to any given number, diverges to oo, or oscillates. 


Theorem 4.3.26 Suppose that )--~_, dn is conditionally convergent and 1 and v are 
arbitrarily given in the extended reals, with 4 < v. Then the terms of ¥-?-_, dn can be 


rearranged to forma series )-?~_, bn with partial sums 


Bn = by + bo +--+ +)Dn, n>1, 


such that _ 
lim B, =v and lim Bh=uwp. (4.3.25) 


Ee. noo 


Proof We consider the case where jz and v are finite and leave the other cases to you 
(Exercise 4.3.36). We may ignore any zero terms that occur in }“P°_, dn. For convenience, 
we denote the positive terms by P = {a;}9° and and the negative terms by Q = {—8;}9°. 
We construct the sequence 


{bn}? = {01,...,@m,,—B1,.--,—Bny, Om, +1, ---> me, —Bny41,---,—Bng,--- 
(4.3.26) 
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with segments chosen alternately from P and Q. Let mp = no = 0. If k > 1, let mg and 
nx be the smallest integers such that mp > mp_1,Nk > NK-1, 


Nk-| 


Mk Mk Nk 
Yiai- >) By =v. and Yi ai— >) Bj <u. 
j=l j=l 


i=1 i=1 


Theorem 4.3.25 implies that this construction is possible: since }° a; = 7 B; = 00, we 
can choose mx and nx so that 


Mk nk 
> a; and 2 B; 


i=mk-1 J=Nk-1 


are as large as we please, no matter how large mz_, and ng_, are (Exercise 4.3.23). Since 
mg and nx are the smallest integers with the specified properties, 


V < Byytny_,» <V+Qm,, k >= 2, (4.3.27) 
and 
B= Bap < Bazin, SH, = 2. (4.3.28) 
From (4.3.26), by < Oif me +ng_) <n < my +g, 80 


Bmj,-tng <Bn< Bm,-+ng_1> mM +ng-y ln smE+N«K, (4.3.29) 


while b, > Oif me +ng <n < mp4, +x, 80 


Bmj,-+ng = Bn s Bing tng Me+NR SNS Mk+1 + Nk. (4.3.30) 
Because of (4.3.27) and (4.3.28), (4.3.29) and (4.3.30) imply that 


Hh — Bn, <Bn<V+Qm,, Mme +ng-y <n<mg+ng, (4.3.31) 

and 
M—Bny < Ban <V+Qmg,,, Mk +N Sn < m4 + NK. (4.3.32) 
From the first inequality of (4.3.27), B, = v for infinitely many values of n. However, 
since limj;—o0 a; = 0, the second inequalities in (4.3.31) and (4.3.32) imply that ife > 0 
then B, > v + € for only finitely many values of n. Therefore, lim, Bn = v. From 
the second inequality in (4.3.28), B, < yw for infinitely many values of n. However, since 


limj+oo B; = 0, the first inequalities in (4.3.31) and (4.3.32) imply that if € > 0 then 


By < je — € for only finitely many values of n. Therefore, lim, _,., Bn = LL. aa) 


Multiplication of Series 


The product of two finite sums can be written as another finite sum: for example, 
(ao + a1 + a2)(bo + bi + b2) = anbo + aob1 + aob2 
+aybo + aiby + ay bz 
+dzbo + azb + Arbo, 
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where the sum on the right contains each product a;b; (i, 7 = 0, 1,2) exactly once. These 
products can be rearranged arbitrarily without changing their sum. The corresponding 
situation for series is more complicated. 


Given two series 


CO [oe 
~ an and > by 
n=0 n=0 


(because of applications in Section 4.5, it is convenient here to start the summation index 
at zero), we can arrange all possible products a;b; (i, 7 > 0) in a two-dimensional array: 


agho agbi agb2 aob3 

aybo a,b; ayb2 a,b3 

a2bo ab, ad2bz drb3 +: (4.3.33) 
a3bo a3b1 a3b2 a3b3 are, 


where the subscript on a is constant in each row and the subscript on b is constant in each 
column. Any sensible definition of the product 


(E>) (&") 


clearly must involve every product in this array exactly once; thus, we might define the 
product of the two series to be the series )°7°.9 pn, where {pn} is a sequence obtained 
by ordering the products in (4.3.33) according to some method that chooses every product 
exactly once. One way to do this is indicated by 


aoho > agb; agb2 > agb3 
y t y 
aybo < a,b, ayb2 a,b3 
y t y 
azbo = azb; = azb2 ae we (4.3.34) 
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and another by 


dgbb —> dob dgb2 —> aob3 agb4 
L a Lo f 
abo a,b, ay;b2 a\b3 
1 7 L f 
azbo azb, azb2 arb; =i (4.3.35) 
va / 
a3bo a3b, a3b2 a3b3 
+ 7 
aaho 


There are infinitely many others, and to each corresponds a series that we might consider 
to be the product of the given series. This raises a question: If 


[oe lo) 
a =A _ and So bn =B 
n=0 n=0 


where A and B are finite, does every product series }-?°.9 Pn constructed by ordering the 
products in (4.3.33) converge to AB? 


The next theorem tells us when the answer is yes. 


Theorem 4.3.27 Let 


[o,@) [o,@) 
Sian =A and So bn = B, 
n=0 n=0 


where A and B are finite, and at least one term of each series is nonzero. Then ¥->-_9 Pn = 
AB for every sequence {py} obtained by ordering the products in (4.3.33) if and only if 
Yan and Y* by converge absolutely. Moreover, in this case, )~ pn converges absolutely. 


Proof First, let {p,} be the sequence obtained by arranging the products {a;b ; } accord- 
ing to the scheme indicated in (4.3.34), and define 
An = a9 +41 ++++4n, An = |ao| + lai] +--+ + lanl, 


By = bo + by +--+ + bn, = |bo| + [bi] +--+ + lbnl, 


Bn 
Pn = pot pit-s:+ Pa, Pn =|polt+|pil+-+:+|Pal- 
From (4.3.34), we see that 

Po = AoBo, P3 = AiBi, Pg = A2Bo, 


and, in general, 
Pon41)2-1 = AmBm. (4.3.36) 


226 Chapter 4 Infinite Sequences and Series 


Similarly, 
P n42-1 = AmBm- (4.3.37) 


If S> |dn| < 00 and Y* |bn| < 00, then {Am Bm} is bounded and, since Pm < P (n41)2-1> 
(4.3.37) implies that {P »} is bounded. Therefore, )~|pn| < 00, 80 > pn converges. Now 


CO 
Y= Pn = lim Pp (by definition) 
=6 n—->oo 


= lim Pon4i2-1 (by Theorem 4.2.2) 


m—->oo 


= lim Am Bm (from (4.3.36)) 


m—->oo 


= ( lim Am) ( lim Bm) (by Theorem 4.1.8) 


m— oo 


= AB. 


Since any other ordering of the products in (4.3.33) produces a a rearrangement of the 
absolutely convergent series }-p-_) Pn, Theorem 4.3.24 implies that > |gn| < co for every 
such ordering and that }°°° 9 dn = AB. This shows that the stated condition is sufficient. 

For necessity, again let }°?°_ Pn be obtained from the ordering indicated in (4.3.34), 
and suppose that )°°2.9 Pn and all its rearrangements converge to AB. Then > py must 
converge absolutely, by Theorem 4.3.26. Therefore, {P,,2_,} is bounded, and (4.3.37) 
implies that {A,,} and {B»} are bounded. (Here we need the assumption that neither )~ ay 
nor )~ by consists entirely of zeros. Why?) Therefore, )> |an| < co and }°|bn| < oo. O 


The following definition of the product of two series is due to Cauchy. We will see the 
importance of this definition in Section 4.5. 


Definition 4.3.28 The Cauchy product of \~?--9 dn and Y-r°.9 bn iS Y-y-9 Cn, Where 
Cn = dobn + a1Dn—1 + +++ + Gn—1b1 + anbdo. (4.3.38) 
Thus, c, is the sum of all products ajb;, where i > 0, 7 > 0, andi + j =n; thus, 


n n 
C—O = tin (4.3.39) 
r=0 r=0 Hi 


Henceforth, ()-72-9 dn) (Sop bn) should be interpreted as the Cauchy product. Notice 


(Z-)(E")- (EE) 


and that the Cauchy product of two series is defined even if one or both diverge. In the case 
where both converge, it is natural to inquire about the relationship between the product of 
their sums and the sum of the Cauchy product. Theorem 4.3.27 yields a partial answer to 
this question, as follows. 
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Theorem 4.3.29 If 7-9 an and Y-P-.9 bn converge absolutely to sums A and B, 
then the Cauchy product of ¥~?-.9 dn and ¥->-9 bn converges absolutely to AB. 


Proof Let C, be the nth partial sum of the Cauchy product; that is, 
Cn = Co ter tes +n 


(see (4.3.38)). Let )°°-.9 Pn be the series obtained by ordering the products {a;,b;} ac- 
cording to the scheme indicated in (4.3.35), and define P, to be its nth partial sum; thus, 
Pn = Pot pi +--+: + Pn. 


Inspection of (4.3.35) shows that c,, is the sum of the n + 1 terms connected by the diagonal 
arrows. Therefore, C, = Pm,,, where 
n(n + 3) 

ae 


From Theorem 4.3.27, limpoo Pm, = AB, so limpsoo Cp = AB. To see that )* |cn| < 
oo, we observe that 


my, =14+2+4+---4+(@4+1)-1l= 


Mn 


n 
> ler] < x IPs| 
r=0 s=0 
and recall that }*|ps| < oo, from Theorem 4.3.27. q 


Example 4.3.25 Consider the Cauchy product of )°?°.) r” with itself. Here a, = 
bn =r" and (4.3.39) yields 


1 1 


Cp rr prt pe pel tr? = (nt Dr", 


so 
CO 2 [oe 
(>: r = Yia + 1)r”. 
n=0 n=0 
Since 
1 
re = Ir| <1, 
n=0 
and the convergence is absolute, Theorem 4.3.29 implies that 


= 1 
Yoat yr" = ao Ir} <1. 
n=0 


Example 4.3.26 If 
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then (4.3.39) yields 


7 n qr Be _ 1 n a —— _@+py" +BY, 
w= Le anim ~ a (")é B ae nee 
thus, 
Tet) (ys BE) _ e+ 8" 
(>: =“) (>: ) = 2 a (4.3.40) 


You probably know from calculus that }°°°_) x”/n! converges absolutely for all x to e*. 
Thus, (4.3.40) implies that 

a 0B = ett 
a familiar result. a 


The Cauchy product of two series may converge under conditions weaker than those 
of Theorem 4.3.29. If one series converges absolutely and the other converges condi- 
tionally, the Cauchy product of the two series converges to the product of the two sums 
(Exercise 4.3.40). If two series and their Cauchy product all converge, then the sum of 
the Cauchy product equals the product of the sums of the two series (Exercise 4.5.32). 
However, the next example shows that the Cauchy product of two conditionally convergent 
series may diverge. 


Example 4.3.27 If 


then 7P29 dn and $°°°_, by converge conditionally. From (4.3.39), the general term of 
their Cauchy product is 


_ x (-17)(-1)"7*! : Cy" 3 1 1 
~ Lr lJ/n—rtl | “fet ivn—r +1 


sO 


+1 
en] 2 3 At r- 
n+1J/n+1 n+1 
Therefore, the Cauchy saan rane by Corollary 4.3.6. 


4.3 Exercises 


1. Prove Theorem 4.3.2. 
2. Prove Theorem 4.3.3. 


3. (a) Prove: Ifa, = by except for finitely many values of n, then }* ay and by 
converge or diverge together. 


10. 
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(b) Let by», = ax for some increasing sequence {nx }$° of positive integers, and 
by = Oif n is any other positive integer. Show that 


foe) 


CO 
ye b, and > an 
n=1 


n=1 


diverge or converge together, and that in the latter case they have the same sum. 
(Thus, the convergence properties of a series are not changed by inserting zeros 
between its terms.) 


(a) Prove: If }* a, converges, then 
lim (Qn + Qn41 +°*++4n4r) =0, r>0O. 
n—->oo 
(b) Does (a) imply that }* a, converges? Give a reason for your answer. 


Prove Corollary 4.3.7. 


(a) Verify Corollary 4.3.7 for the convergent series )°1/n? (p > 1). HINT: See 
the proof of Theorem 4.3.10. 


(b) Verify Corollary 4.3.7 for the convergent series )“(—1)" /n. 
Prove: If 0 < by < dn < bn+i, then )° ay and >> by, converge or diverge together. 


Determine — or divergence. 
@) SECT 
(c) pe (4) 00s *, 
(e) SosinS (f) tan 
(g) Yo = cot * (n) 3" 


Suppose that f(x) > 0 for x > k. Prove that ihe F(x) dx < oo if and only if 


ad n+1 
p> f(x) dx < o. 


n=k°" 
HINT: Use Theorems 3.4.5 and 4.3.8. 


Use the integral test to find all values of p for which the series converges. 


n n? sinhn 
(a)>" Gp (b) ) Ga4aaP 2 Gane 
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11. 


12. 


13. 


14. 


15. 
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Let Ly be the nth iterated logarithm. Show that 
1 
dX Lo(n)L1(n) +++ Len) [Legi (ny? 
converges if and only if p > 1. HINT: See Exercise 3.4.10. 
Suppose that g, g’, and (g’)? — gg” are all positive on [R, 00). Show that 


if and only if limy—oo g(x) < ©. 


Let 
= 
SGj= >i Bek 
n=1 
Show that 
; < S(p) > < : 
(P= DV + Pt SO Lae * (pNP 


HINT: See the proof of Theorem 4.3.10. 


Suppose that f is positive, decreasing, and locally integrable on [1, oo], and let 


a> fO=1 POE. 
Le f 


(a) Show that {ay} is nonincreasing and nonnegative, and 
0< lim a, < f(1). 
n—-oo 
(b) Deduce from(a) that 
. 1 1 1 
y= lim {1+ -+-+--:-+-—-—logn 
noo 2 3 n 


exists, and 0 < y < 1. (y is Euler’s constant; y © 0.577.) 


Determine convergence or divergence. 


pgs 2+ sinné (b) ot Hr > 0) 


n2 + sinn@ 


1 
(c) be coshnp (p > 0) (d) > ent 


c pps Ox oy 


n? logn 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 
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Let Ly, be the nth iterated logarithm. Prove that 
1 
2 [Lo(ny4o7" Lay] + [Lm (ny 
converges if and only if there is at least one nonzero number in {qo, q1,.--,@m} and 
the first such is positive. HINT: See Exercises 4.3.11 and 2.4.42(b). 


Determine convergence or divergence. 


(a py (nz /4) (b) Me) 
(0) Se Sasi) (d ay ene" 1)” 


n(n + 1) n(n + 1) 
Determine convergence or divergence, with r > 0. 


(a) (b) So n?r" (ce) Oo 
(d) > a +D! (e))_ on 


Determine convergence or divergence. 


(2n)! (3n)! 
@) Lama ©) Lisemecr nia ro 


a(a+1)---(@+n—1) 
Oley OLagrpagersy @F>9 
Determine convergence or divergence. 


are Ors). 
(c) @+)) ——o Obs ( - 


Give counterexamples showing that the following statements are false unless it is 

assumed that the terms of the series have the same sign for n sufficiently large. 

(a) >°a, converges if its partial sums are bounded. 

(b) Ifb, 4 0 forn > k and limy+o0 dn/bn = L, where 0 < L < 00, then an 
and )° by, converge or diverge together. 

(c) Ifdn 4 Oand limy—+o0 dn41/dn < 1, then >> dy converges. 

(d) Ifan #0 and limy—+oo n [(€n41/an) — 1] < —1, then > ay converges. 

Prove: If the terms of a convergent series 7 dy have the same sign forn > k, then 

> dy converges absolutely. 


Suppose that a, > 0 forn > m and )* ay = ov. Prove: If N is an arbitrary integer 
> mand J is an arbitrary positive number, then aoe ay, > J for some positive 
integer k. 


Prove Theorem 4.3.19. 
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25. 


26. 


27. 


28. 


29. 
30. 


31. 


32. 


Show that the series converges absolutely. 


4 1 sinn@ 
(a) xe) ona? (b) a 


(c) Dey sins (a) SS cosn6é 


Show that the series converges. 


nsinn@ cosn@ . 
(a) eewerani3 n2 + (—lP (—oo < 6 < 00) (b) ae (6 4 2kx, k = integer) 
Determine whether the series is absolutely convergent, aceon convergent, or 
divergent. 


bn 
(a) a On (bam = bam+1 = 1, bam42 = bam+3 = —1) 


(b) Yo sin (c) ee 


1-3-5---(2n + 1) 
(d) 
4-6-8---(2n + 4) 
Let g be a rational function (ratio of two polynomials). Show that )* g(”)r” con- 
verges absolutely if |r| < 1 or diverges if |r| > 1. Discuss the possibilities for 
Ir| =1. 
Prove: If }° a? < oo and )* b? < oo, then )* aby converges absolutely. 


sinnd 


(a) Prove: If }° a, converges and )>a? = oo, then )\ ay converges condition- 
ally. 
b) Give an example of a series with the properties described in (a). 
p prop: 


Suppose that 0 < dn+41 < dy, and 


: by t+bhot---+bhy 
fir eo, 


n—->oo Wn 


where {w,} is a sequence of positive numbers such that 


>a Wn(An — Gn4+1) = 00 


Show that )> dn bn = co. HINT: Use summation by parts. 
(a) Prove: If 0 < 2« < 0 < m —2e, then 


i | sin #| + | sin26| +---+|sinné| ,, sine 
im A > —_ 
HINT: Show that |sinn6| > sine at least “half the time”; more precisely, 
show that if | sinm®@| < sine for some integer m then | sin(m + 1)6| > sine. 


33. 


34. 


35. 


36. 


37. 


38. 


39. 


40. 
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(b) Show that 


sinné 
pier: 
converges conditionally if 0 < p < 1 and 6 4 ka (k = integer). HINT: Use 
Exercise 4.3.31 and see Example 4.3.22. 


Show that 
s pe _ 1 3s 1 
ore n a n(2n — 1) 
Let b3m+41, D3m+2 = —2, and b3m43 = 1 form > 0. Show that 


Uy ae 1 
an 3 Gt Gm+ Gm 42) 


Let 5° by be obtained by rearranging finitely many terms of a convergent series 
ys dy. Show that the two series have the same sum. 


Prove Theorem 4.3.26 for the case where (a) / is finite and v = 00; (b) pp = —oo 
and v = 00; (c) # =v =o0. 


Give necessary and sufficient conditions for a divergent series to have a convergent 
rearrangement. 


A series diverges unconditionally to oo if every rearrangement of the series diverges 
to oo. State necessary and sufficient conditions for a series to have this property. 


Suppose that f and g have derivatives of all orders at 0, and let h = fg. Show 


formally that 
Os gO) h©O) 
(EP) (ESP) E52 


n=0 
in the sense of the Cauchy product. HINT: See Exercise 2.3.12. 


Prove: If }* |an| < oo and }* by converges (perhaps conditionally), with )-7-9 dn = 
A and °°. 9 bn = B, then the Cauchy product 


Cc CO CO 
n=0 n=0 n=0 
converges to AB. HINT: Let {An}, {Bn}, and {Cy} be the partial sums of the series. 


Show that 
n 
B= > Gr(Br — B) 
r=0 


and apply Theorem 4.3.5 to Y- |an|- 
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41. Suppose that a, > 0 for all r > 0 and and )°>° a, = A < oo. Show that 


n—-1 n—-1 
lim — ) ar+s =O and lim — ) ar—s = 2A— ao. 
n->on n->won 

r,s=0 r,s=0 


A2. Prove: If limj+5 a\) =a; (j = land ja | <0; (i,j = 1), where em oj < 


oo, then limj+oo 772 a\) = on 4). 


4.4 SEQUENCES AND SERIES OF FUNCTIONS 


Until now we have considered sequences and series of constants. Now we turn our attention 
to sequences and series of real-valued functions defined on subsets of the reals. Throughout 
this section, “subset” means “nonempty subset.” 


If Fe, Feii,---, Pn,... are real-valued functions defined on a subset D of the reals, 
we say that {F,} is an infinite sequence or (simply a sequence) of functions on D. If the 
sequence of values { F;,(x)} converges for each x in some subset S of D, then { F,} defines 
a limit function on S. The formal definition is as follows. 


Definition 4.4.1 Suppose that {F;,} is a sequence of functions on D and the sequence 
of values {F,(x)} converges for each x in some subset S of D. Then we say that {F,} 
converges pointwise on S to the limit function F , defined by 


F(x) = lim F,(x), x eS. 


Example 4.4.1 The functions 


_ n/2 


define a sequence on D = (—on, 1], and 


oo, x <0, 
lim Fyx(x)= 41, x«=0, 
ae 0, O<x<1. 


Therefore, {F;,} converges pointwise on S = [0, 1] to the limit function F defined by 


1 x=0, 
FO) =o g<x<1. 
Example 4.4.2 Consider the functions 


Fi(x)=x"e"™, x>0, n=l, 


(Figure 4.4.1). 
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y 


y =F (x)=x"e™ 


Figure 4.4.1 


Equating the derivative 
F!(x) = nx" 1e*(1 — x) 


to zero shows that the maximum value of F,(x) on [0, 00) is e~”, attained at x = 1. 


Therefore, 
[Fn(x)|<e", x>=0, 


SO limy-+o0 Fy (x) = 0 for all x > 0. The limit function in this case is identically zero on 
[0, 00). 


Example 4.4.3 Forn > 1, let F, be defined on (—oo, oo) by 


0, x< —2, 
—n(2 +nx), —2 <x <-t, 
Fy(x) = 4n?x, -i <x< 1. 
n(2 —nx), t<x<2, 
0, x>2 
—n 


(Figure 4.4.2, page 236), 


Since F,,(0) = 0 for all 1, limp—oo Fn (0) = 0. If x 4 0, then F, (x) = Oifn > 2/|x|. 
Therefore, 
lim Fy(x) =0, -coo<x<o, 
noo 


so the limit function is identically zero on (—oo, oo). 


Example 4.4.4 For each positive integer n, let S, be the set of numbers of the form 
x = p/q, where p and q are integers with no common factors and 1 <q <n. Define 


1, xeéeS,, 


Fa(x) = 0, x ¢Sy. 
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If x is irrational, then x ¢ S, for any n, so F,(x) = 0,n > 1. If x is rational, then x € S, 
and F,(x) = 1 for all sufficiently large n. Therefore, 


if x is rational, 


: 1 
pis fe) Ee 0 if x is irrational. 


Figure 4.4.2 


Uniform Convergence 


The pointwise limit of a sequence of functions may differ radically from the functions in 
the sequence. In Example 4.4.1, each F, is continuous on (—oo, 1], but F is not. In 
Example 4.4.3, the graph of each F, has two triangular spikes with heights that tend to 
oo as n —> oo, while the graph of F (the x-axis) has none. In Example 4.4.4, each F, 
is integrable, while F is nonintegrable on every finite interval. (Exercise 4.4.3). There is 
nothing in Definition 4.4.1 to preclude these apparent anomalies; although the definition 
implies that for each x9 in S, Fy (xo) approximates F(xo) if n is sufficiently large, it 
does not imply that any particular F;, approximates F well over all of S. To formulate a 
definition that does, it is convenient to introduce the notation 


IIglls = sup |g(x)| 
xeS 
and to state the following lemma. We leave the proof to you (Exercise 4.4.4). 


Lemma 4.4.2 If g and h are defined on S, then 


lg + Alls < llglls + llAlls 
and 


IIghlls < lglsllAlls. 


Moroever, if either g or h is bounded on S, then 


lg —Alls = IIlglls — llAls Il. 


Section 4.4 Sequences and Series of Functions 237 


Definition 4.4.3 A sequence {F,,} of functions defined on a set S converges uniformly 
to the limit function F on S if 


lim ||F, — Fly = 0. 
n—-oo 
Thus, {F;,} converges uniformly to F on S if for each € > 0 there is an integer N such that 


|Fn—-Flls<e if n=N. (4.4.1) 
a 


If S = [a, b] and F is the function with graph shown in Figure 4.4.3, then (4.4.1) implies 
that the graph of 


lies in the shaded band 
F(x)-e<y<F(x)+e, a<x<b, 


ifn >N. 


From Definition 4.4.3, if {F,} converges uniformly on S, then { F,,} converges uniformly 
on any subset of S' (Exercise 4.4.6). 


y=F (x) +e 
y =F (x) 
y=F (x)-e 


Figure 4.4.3 


Example 4.4.5 The sequence { F,,} defined by 
Fy(x) =x"e"™, n>, 


converges uniformly to F = 0 (that is, to the identically zero function) on S = [0, 00), 
since we saw in Example 4.4.2 that 


[Fn — Flls = |lFnlls =e™, 
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so 
ln =fle<e 


ifn > —loge. For these values of n, the graph of 
y=Fi(x), O<x <ov, 


lies in the strip 


(Figure 4.4.4). | 


The next theorem provides alternative definitions of pointwise and uniform convergence. 
It follows immediately from Definitions 4.4.1 and 4.4.3. 


Theorem 4.4.4 Let {F,} be defined on S. Then 


(a) {F,} converges pointwise to F on S if and only if there is, for each e > Oandx € S, 
an integer N (which may depend on x as well as €) such that 


|Fn(x) -—F(x)|<e€ if n>QN. 


(b) {Fy} converges uniformly to F on S if and only if there is for each € > 0 an integer 
N (which depends only on € and not on any particular x in S) such that 


|Fn(x) — F(x)| <e€ forallxinSifn>=N. 


N y—nx 


y =x"e 


> xX 


Figure 4.4.4 


The next theorem follows immediately from Theorem 4.4.4 and Example 4.4.6. 
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Theorem 4.4.5 /f{F,} converges uniformly to F on S, then { F,} converges pointwise 
to F on S. The converse is false; that is, pointwise convergence does not imply uniform 
convergence. 


Example 4.4.6 The sequence {F,,} of Example 4.4.3 converges pointwise to F = 0 
on (—oo, oo), but not uniformly, since 


1 
Fa Flicsoa) = Fa (=) = 


NY) 
lim I| Fn — F || (00,00) =O. 
noo 


However, the convergence is uniform on 
Sp = (—0, p] U [p, 0) 


for any p > 0, since 


. 2 
Fn —Flls, =0 if n>-. 
p 


Example 4.4.7 If F,(x) = x”, n > 1, then {F,} converges pointwise on S = [0, 1] 
to 
lL. «=1, 


2 en ae ee 


The convergence is not uniform on S. To see this, suppose that 0 < « < 1. Then 
Piel slaear ao!" 2x< 1; 


Therefore, 
l—es|%-—F ls 51 


for all n => 1. Since € can be arbitrarily small, it follows that 
Fn -— Fills =1 


for alln > 1. 


However, the convergence is uniform on [0, p] if 0 < p < 1, since then 
[Fn — Fllto,o) = 2” 


and limp—+oo p” = 0. Another way to say the same thing: {F;,} converges uniformly on 
every closed subset of [0, 1). | 


The next theorem enables us to test a sequence for uniform convergence without guessing 
what the limit function might be. It is analogous to Cauchy’s convergence criterion for 
sequences of constants (Theorem 4.1.13). 
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Theorem 4.4.6 (Cauchy’s Uniform Convergence Criterion) A sequence 
of functions { F,} converges uniformly on a set S if and only if for each € > 0 there is an 
integer N such that 

|Fn -—Fnlls<¢€ if num>N. (4.4.2) 


Proof For necessity, suppose that { F,,} converges uniformly to F on S. Then, if « > 0, 
there is an integer N such that 


Fx — F lls <5 if k>N. 
Therefore, 


Fn — Fm|ls = ||(Fn — F) + (F — Fin) Ils 
< ||Fn - Fils + | F — Fils (Lemma 4.4.2) 
stax if m,n>QN. 
For sufficiency, we first observe that (4.4.2) implies that 
|Fun(x) — Fn(x)| <e€ if nom>QN, 


for any fixed x in S. Therefore, Cauchy’s convergence criterion for sequences of constants 
(Theorem 4.1.13) implies that {F;,(x)} converges for each x in S; that is, {F,} converges 
pointwise to a limit function F on S. To see that the convergence is uniform, we write 


| Fm (x) — FQx)| = |[Fm (x) — Fn )] + [Fn 0) — F(*)II 
S |Fin(x) — Fn (x)| + Fn) — FQ)| 
S Fm — Falls + |Fn(Qx) — F@)I. 


This and (4.4.2) imply that 
|Fin(x) — F(x)| <€+|Fn(x)-—F(x)| if n,m>QN. (4.4.3) 
Since limy—+o9 Fy (x) = F(x), 
| Fn(x) — F(x)| <€ 
for some n => N, so (4.4.3) implies that 
|Fin(x) — F(x)| <2e if m>N. 
But this inequality holds for all x in S, so 
|Fin —F lls <2€ if m>N. 


Since € is an arbitrary positive number, this implies that {F,} converges uniformly to F 
on S. q 


The next example is similar to Example 4.1.14. 
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Example 4.4.8 Suppose that g is differentiable on S = (—oo, 00) and 
le’@)|<r<1, -co<x<oo. (4.4.4) 
Let Fo be bounded on S and define 
Fi, (x) = g(n-1@)), n> 1. (4.4.5) 


We will show that { F,,} converges uniformly on S. We first note that if uw and v are any two 
real numbers, then (4.4.4) and the mean value theorem imply that 


lg(u) — g(v)| <rlu—v. (4.4.6) 
Recalling (4.4.5) and applying this inequality with u = F,—1(x) and v = 0 shows that 


| Fn(x)| = |g) + (g(Fn-1 (x) — 8())| < [g)| + [g¢Fn-1 (&)) — 8) 
< |g)| +r] Fri ()I; 


therefore, since Fo is bounded on S, it follows by induction that F,, is bounded on S for 
n > 1. Moreover, ifn > 1, then (4.4.5) and (4.4.6) with u = F,(x) and v = Fy_-1(x) 
imply that 


|Fn+1 (x) — Fa (x)| = |g(Fn (&)) — 8(Fn-1 (*))| S11 Fn (0) — Fr-1(X)|, 00 < x < 00, 


so 
| Fnti — Falls < r|| Fn - Fr-ills- 


By induction, this implies that 
| Fn+1 — Falls <r" || Fi — Folls. (4.4.7) 
Ifn > m, then 


|| Fn — Fills = ||Pn — Fn-1) + (Fn-1 — Fn-2) +++ + (Finti — Fin) Ils 
s I| Fn — Fy-ills + I| Fn-1 — Fy-2lls ois || Fmt — Frills. 


from Lemma 4.4.2. Now (4.4.7) implies that 


|Fo— Falls <||Fi— Polls trtr? +--+ 2-1)” 
r™ 


< ||Fi- Folls ; 
l-r 


Therefore, if 


N 
- 
| Fi — Folls — 


1 


then || Fn — Fin|ls < € ifn, m > N. Therefore, {F,} converges uniformly on S, by 
Theorem 4.4.6. 
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Properties Preserved by Uniform Convergence 


We now study properties of the functions of a uniformly convergent sequence that are 
inherited by the limit function. We first consider continuity. 


Theorem 4.4.7 /f {F,} converges uniformly to F on S and each Fy is continuous at 
a point xg in S, then so is F. Similar statements hold for continuity from the right and left. 


Proof Suppose that each F,, is continuous at xo. If x € S andn > 1, then 


| F(x) — F(xo)| S |F(&) — Fn &)| + |Fn (x) — Fa (%0)| + |Fn(%0) — Fo) 


<|Fa(x) — Fn(Xo)| + 2I| Fn — Fils. (4.4.8) 


Suppose that € > 0. Since {F,} converges uniformly to F on S, we can choose n so that 
| Fn — F'||s < €. For this fixed n, (4.4.8) implies that 


|F(x) — F(xo)| < |Fu(x) — Fn(xo)| + 2€, x ES. (4.4.9) 
Since F;, is continuous at xg, there is ad > O such that 
|Fn(x) — Fr(xo)| <e¢ if |x —xo| <6, 


so, from (4.4.9), 
|F(x) — F(xo)| <3e, if |x—xo| <6. 


Therefore, F is continuous at x9. Similar arguments apply to the assertions on continuity 
from the right and left. q 


Corollary 4.4.8 If {F,} converges uniformly to F on S and each Fy, is continuous on 
S, then so is F; that is, a uniform limit of continuous functions is continuous. 


Now we consider the question of integrability of the uniform limit of integrable func- 
tions. 


Theorem 4.4.9 Suppose that {F;,} converges uniformly to F on S = [a,b]. Assume 
that F and all F,, are integrable on |a, b|. Then 


b b 
/ F(x)dx = lim, | F(x) dx. (4.4.10) 


Proof Since 


[ racoar— [ reoax 


a a 


b 
< / [Fa(x) — FQ) | dx 


< (b—a)||Fn — Flls 


and limy-+o0 || Fn — F'||s = 0, the conclusion follows. an 
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In particular, this theorem implies that (4.4.10) holds if each F, is continuous on [a, 5], 
because then F is continuous (Corollary 4.4.8) and therefore integrable on [a, b]. 


The hypotheses of Theorem 4.4.9 are stronger than necessary. We state the next theorem 


so that you will be better informed on this subject. We omit the proof, which is inaccessible 
if you skipped Section 3.5, and quite involved in any case. 


Theorem 4.4.10 Suppose that {F,} converges pointwise to F and each Fy is inte- 
grable on [a, b]. 


(a) Ifthe convergence is uniform, then F is integrable on a, b] and (4.4.10) holds. 


b) Uf the sequence {|| Fy\ltq.p)t is bounded and F is integrable on [a, b], then (4.4.10) 
q [a,b] 8 
holds. 


Part (a) of this theorem shows that it is not necessary to assume in Theorem 4.4.9 that F 
is integrable on [a, b], since this follows from the uniform convergence. Part (b) is known 
as the bounded convergence theorem. Neither of the assumptions of (b) can be omitted. 
Thus, in Example 4.4.3, where {|| Fy ||[o,1)} is unbounded while F is integrable on [0, 1], 


1 1 
i; Fi(x)dx =1, n2>I1, but / F(x) dx =0. 
0 0 


In Example 4.4.4, where || Fy ||[a,p) = 1 for every finite interval [a, b], F, is integrable for 
alln > 1, and F is nonintegrable on every interval (Exercise 4.4.3). 


After Theorems 4.4.7 and 4.4.9, it may seem reasonable to expect that if a sequence { F;,} 
of differentiable functions converges uniformly to F on S, then F’ = limy-+o0 F; on S. 
The next example shows that this is not true in general. 


Example 4.4.9 The sequence { F,,} defined by 


1 
Fy, (x) = x” sin as 


converges uniformly to F = 0 on [r1,1r2] if 0 < ry < ro < 1 (or, equivalently, on every 
compact subset of (0, 1)). However, 


Fi (x) = nx"! sin —(n —1)cos 


xn-l xn-l? 


so {F/ (x)} does not converge for any x in (0, 1). 


Theorem 4.4.11 Suppose that F/ is continuous on [a,b] for alln > 1 and {F/} 
converges uniformly on [a, b]. Suppose also that { Fy(xo)} converges for some Xo in [a, b]. 
Then { F,} converges uniformly on |a, b] to a differentiable limit function F, and 


F'(x) = tim. Fi@), a@<x <b, (4.4.11) 


while 
F(a) = lim Fi(at+) and F‘(b) = lim F/(b-). (4.4.12) 
A006 aco 
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Proof Since F’ is continuous on [a, b], we can write 


F(x) = Fy(xo) + ie Fi(tj)dt, a<x<b (4.4.13) 


xo 
(Theorem 3.3.12). Now let 
L= lim Fy(xo) 
n—->oo 
and 


G(x) = lim Fy (x). (4.4.14) 


Since F, is continuous and {F/} converges uniformly to G on [a, b], G is continuous on 
[a, b] (Corollary 4.4.8); therefore, (4.4.13) and Theorem 4.4.9 (with F and F;, replaced by 
G and F’) imply that {F;,} converges pointwise on [a, 5] to the limit function 


F(x) =L+ [ G(t) dt. (4.4.15) 
xo 


The convergence is actually uniform on [a,b], since subtracting (4.4.13) from (4.4.15) 
yields 
x 
| F(x) — Fa(x)| < |L — Fn(%o)| + i IG@) — F, (0)| dt 
xO 
<|L — Fn(xo)| + |x — xo] |G — Frllta,a1- 


so 
IF — Falltao) < |L — Fn(x0)| + 6 — 4) |G — Fyllta.oy, 
where the right side approaches zero as n — oo. 


Since G is continuous on [a, b], (4.4.14), (4.4.15), Definition 2.3.6, and Theorem 3.3.11 
imply (4.4.11) and (4.4.12). an 


Infinite Series of Functions 


In Section 4.3 we defined the sum of an infinite series of constants as the limit of the 
sequence of partial sums. The same definition can be applied to series of functions, as 
follows. 


Definition 4.4.12 If {f;}?° is a sequence of real-valued functions defined on a set D 


of reals, then aoe f; is an infinite series (or simply a series) of functions on D. The 
partial sums of , °°, fj are defined by 


n 
iS) Fe HEE 
j=k 


If {Fn}f° converges pointwise to a function F ona subset S of D, we say that aes Ai 
converges pointwise to the sum F on S, and write 


P=)" Gy eS, 
j=k 
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If {F,} converges uniformly to F on S, we say that aan fj converges uniformly to F 
on S. 


Example 4.4.10 The functions 
fiax)=x!, jf 20, 

define the infinite series 

[o,@) 

Be 

j=0 
on D = (—oo, 00). The nth partial sum of the series is 

Fie) = law ea ee te", 


or, in closed form, 
1— ntl 


> ve 1, 
HOS. 49 FF 
n+l, x= 1 


(Example 4.1.11). We have seen earlier that { F,} converges pointwise to 
1 
F(x) = —— 
1-x 
if |x| < 1 and diverges if |x| > 1; hence, we write 


[oe 
. 1 

aS , -l<x<l. 

: 1-x 

J=0 


Since the difference 
n+1 


F(x) — Fa(x) = — 


can be made arbitrarily large by taking x close to 1, 


| F — Falla. = 09, 


so the convergence is not uniform on (—1, 1). Neither is it uniform on any interval (—1, 7] 


with —1 <r < 1, since 
1 
IF — Faller = 2 


for every n on every such interval. (Why?) The series does converge uniformly on any 
interval [—r, r] withO <r < 1, since 


n+1 


7 
|F — Fallt—rr) = = 


and limy—o0 r” = 0. Put another way, the series converges uniformly on closed subsets of 
(=1,1). a 
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As for series of constants, the convergence, pointwise or uniform, of a series of functions 
is not changed by altering or omitting finitely many terms. This justifies adopting the 
convention that we used for series of constants: when we are interested only in whether a 
series of functions converges, and not in its sum, we will omit the limits on the summation 
sign and write simply > fr. 

Tests for Uniform Convergence of Series 


Theorem 4.4.6 is easily converted to a theorem on uniform convergence of series, as fol- 
lows. 


Theorem 4.4.13 (Cauchy’s Uniform Convergence Criterion) A series 
> fn converges uniformly on a set S if and only if for each € > 0 there is an integer N 
such that 


lit tea te lle ee af mene nN, (4.4.16) 


Proof Apply Theorem 4.4.6 to the partial sums of }> f,, observing that 


dnt fata e+e + Sm = Fin — Pris a 


Setting m = n in (4.4.16) yields the following necessary, but not sufficient, condition 
for uniform convergence of series. It is analogous to Corollary 4.3.6. 


Corollary 4.4.14 If>* f, converges uniformly on S, then limy-+co || fnlls = 0. 


Theorem 4.4.13 leads immediately to the following important test for uniform conver- 
gence of series. 


Theorem 4.4.15 (Weierstrass’s Test) The series )~ fn converges uniformly 
on S if 
falls < Mn, n=k, (4.4.17) 


where >> Mn < 00. 
Proof From Cauchy’s convergence criterion for series of constants, there is for each 
€ > Oan integer N such that 
Mn+ Mn4it+:::+Mn<e if m>n=N, 
which, because of (4.4.17), implies that 
[falls + fntills +-°-+ I fmlls<¢€ if mn2N. 
Lemma 4.4.2 and Theorem 4.4.13 imply that > f, converges uniformly on S. q 
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Example 4.4.11 Taking M, = 1/n? and recalling that 


we see that 


converge uniformly on (—oo, 00). 


Example 4.4.12 The series 


Dame =T(FR) 


converges uniformly on any set S such that 


| <r<l, xeS, (4.4.18) 
1l+x 


because if S is such a set, then 
| falls <r” 


and Weierstrass’s test applies, with 


So Mn = a <o. 


Since (4.4.18) is equivalent to 


—r r 
<x< 


l+r7 ~1-r 


this means that the series converges uniformly on any compact subset of (—1/2, 00). 
(Why?) From Corollary 4.4.14, the series does not converge uniformly on S = (—1/2, b) 
with b < co oron S = [a, oo) with a > —1/2, because in these cases || fy || = 1 for all 
n. ai 


Weierstrass’s test is very important, but applicable only to series that actually exhibit a 
stronger kind of convergence than we have considered so far. We say that > fy converges 
absolutely on S if ¥~|f,| converges pointwise on S, and absolutely uniformly on S if 
> | fn| converges uniformly on S. We leave it to you (Exercise 4.4.21) to verify that our 
proof of Weierstrass’s test actually shows that )> f, converges absolutely uniformly on S. 
We also leave it to you to show that if a series converges absolutely uniformly on S, then it 
converges uniformly on S (Exercise 4.4.20). 


The next theorem applies to series that converge uniformly, but perhaps not absolutely 
uniformly, on a set S. 
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Theorem 4.4.16 (Dirichlet’s Test for Uniform Convergence) The se- 


ries 
lo) 
do fn&n 
n=k 


converges uniformly on S if {fy} converges uniformly to zero on S, ¥-(fn+i — fn) con- 
verges absolutely uniformly on S, and 


Ilse + Serit---+8nlls 2M, nZk, (4.4.19) 
for some constant M. 
Proof The proof is similar to the proof of Theorem 4.3.20. Let 

Gn = 8k + Se41 ++++ + Bn, 

and consider the partial sums of )°r2, fn&n: 

An = fe&e + Seti8k+i +++ + fn8n- (4.4.20) 
By substituting 

8k = Ge and gn =Gn-Gni, nz2k+, 
into (4.4.20), we obtain 
An = feGe + Seti (Ge+1 — Ge) +°+++ fn(Gn - Gn-1), 
which we rewrite as 
An = (fe — Seti )Gk + (Seti — Sfe+2)Geti +++ + Gn-1 -— fn)Gn-1 + fnGn, 


or 
Ay = Jn-1 + InGn, (4.4.21) 


where 


In—-1 = (Se — Seai)Ge + (Seti — Seto) Geai +:°° + Gn-1 — fn)Gn-1. (4.4.22) 


That is, {J,} is the sequence of partial sums of the series 
[oe 
YG - fitG;. (4.4.23) 
= 


From (4.4.19) and the definition of G;, 


YO) — fi @MlG)|) <M VO -Fu@l xe, 


j=n j=n 
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sO 


m m 
Yi - fi40Gi] <M POI - fil 
j=n r j=n g 
Now suppose that € > 0. Since }°(f; — f;+41) converges absolutely uniformly on S', The- 
orem 4.4.13 implies that there is an integer N such that the right side of the last inequality 
is less than € ifm > n > N. The same is then true of the left side, so Theorem 4.4.13 
implies that (4.4.23) converges uniformly on S. 


We have now shown that {J,} as defined in (4.4.22) converges uniformly to a limit 
function J on S. Returning to (4.4.21), we see that 


Ayn -— J = In-1 — J + fnGn. 
Hence, from Lemma 4.4.2 and (4.4.19), 


|| Hn — J Ils S Jn — J Ils + I falls Gals 
S IlJn-1 — Sls + MI falls. 


Since {Jn—1—J} and { f,} converge uniformly to zero on S, it now follows that limp—oo || Hn—- 
J ||s = 0. Therefore, {H,} converges uniformly on S. q 


Corollary 4.4.17 The series ~~, fn&n converges uniformly on S if 
fnti(x) = fax), xES, nek, 
{fn} converges uniformly to zero on S, and 
[ge + Sktit--+8nlls <M, n=k, 


for some constant M. 


The proof is similar to that of Corollary 4.3.21. We leave it to you (Exercise 4.4.22). 


Example 4.4.13 Consider the series 


[o.e) . 
> sInnx 
n 


n=1 


with f, = 1/n (constant), g,(x) = sinnx, and 
Gy(x) = sinx + sin2x +---+ sinnx. 


We saw in Example 4.3.21 that 


1 
IGn(x)| < [sin(x/2)|" n>1, n#2kn (k = integer). 
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Therefore, {||Gn|| 5} is bounded, and the series converges uniformly on any set S on which 
sin x /2 is bounded away from zero. For example, if 0 < 6 < z, then 
5 


x ‘ 
sin —| > sin = 
2 2 


if x is at least 6 away from any multiple of 277; hence, the series converges uniformly on 


S= ( kw +5,2k + 1m -4). 


k=—0o 


y 


(Exercise 4.3.32(b)), this result cannot be obtained from Weierstrass’s test. 


Since : 
sinnx 
—|=o, x¢kn 


Example 4.4.14 The series 
ew 
a 


n 
n=1 
satisfies the hypotheses of Corollary 4.4.17 on (—oo, 00), with 
1 
Sn(x) => ae 8n => (-1)’, Gorm => 0, and Gom+1 => —l. 


Therefore, the series converges uniformly on (—oo, oo). This result cannot be obtained by 
Weierstrass’s test, since 
1 
De n+ x2 ~~ 


for all x. 


Continuity, Differentiability, and Integrability of Series 


We can obtain results on the continuity, differentiability, and integrability of infinite series 
by applying Theorems 4.4.7, 4.4.9, and 4.4.11 to their partial sums. We will state the 
theorems and give some examples, leaving the proofs to you. 


Theorem 4.4.7 implies the following theorem (Exercise 4.4.23). 


Theorem 4.4.18 [f -7-, fn converges uniformly to F on S and each fy is contin- 
uous at a point Xo in S, then so is F. Similar statements hold for continuity from the right 


and left. 
Example 4.4.15 In Example 4.4.12 we saw that the series 


r= (rs) 


n=0 
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converges uniformly on every compact subset of (—1/2, 00). Since the terms of the series 
are continuous on every such subset, Theorem 4.4.4 implies that F is also. In fact, we can 
state a stronger result: F is continuous on (—1/2, 00), since every point in (—1/2, 00) lies 
in a compact subinterval of (—1/2, oo). 


The same argument and the results of Example 4.4.13 show that the function 


°\ sinnx 
Gx) =) — 


n=1 


is continuous except perhaps at x, = 2ka (k = integer). 


From Example 4.4.14, the function 


H(x) = oe 1)” 


— 
n=1 


is continuous for all x. a 


The next theorem gives conditions that permit the interchange of summation and inte- 
gration of infinite series. It follows from Theorem 4.4.9 (Exercise 4.4.25). We leave it to 
you to formulate an analog of Theorem 4.4.10 for series (Exercise 4.4.26). 


Theorem 4.4.19 Suppose that \--°, fn converges uniformly to F on S = [a,b]. 
Assume that F and fy, > k, are integrable on [a, b]. Then 


b oo b 
[ Fovdr= Sof Tn(x) dx. 


We say in this case that }°°°., fn can be integrated term by term over [a, b]. 


Example 4.4.16 From Example 4.4.10, 


1 [oe 
=> x”, -l<x<l. 
= n=0 


The series converges uniformly, and the limit function is integrable on any closed subinter- 


val [a, b] of (—1, 1); hence, 
i= i = -rf x” dx, 
a |-x 


00 prt —q?rtl 
log] — a) —log(1 —b) = = ee 


n=0 


sO 


n+1 
Letting a = 0 and b = x yields 


log —x) = pos -l<x<l. | 
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The next theorem gives conditions that permit the interchange of summation and differ- 
entiation of infinite series. It follows from Theorem 4.4.11 (Exercise 4.4.28). 


Theorem 4.4.20 Suppose that f, is continuously differentiable on [a,b] for eachn = 
k, or. fn(x0) converges for some xo in [a,b], and \~-°, f/ converges uniformly on 
[a,b]. Then )-°_, fn converges uniformly on [a, b] to a differentiable function F, and 


F'(x) = pe Hea) a<x<hb, 
=k 


while 


Fiat) = >° flat) and F'(b-)= > fi(b-). 


n=k n=k 
We say in this case that )~P-, fn can be differentiated term by term on [a, b]. To apply 
Theorem 4.4.20, we first verify that )°P°., fn(xo) converges for some Xo in [a, b] and then 
differentiate )-P°_, fn term by term. If the resulting series converges uniformly, then term 


by term differentiation was legitimate. 


Example 4.4.17 The series 
= 1 x 
> (—1)"— cos — (4.4.24) 
— n n 
converges at x9 = 0. Differentiating term by term yields the series 
= 1 x 
So(-b"t! = sin = (4.4.25) 
= n n 


of continuous functions. This series converges uniformly on (—oo, 00), by Weierstrass’s 
test. By Theorem 4.4.20, the series (4.4.24) converges uniformly on every finite interval to 
the differentiable function 


lo e) 
1 

F(x) = Y\(-1)"=cos = —0o < Xx < 00, 

= n n 
and 

= 1 x 

F'(x) = a ae sin 7B? OOS ¥ <0. 
n=1 


Example 4.4.18 The series 


ox” x2 x3 
E=) = ler Ge hy (4.4.26) 


n= 
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converges uniformly on every interval [—r, r] by Weierstrass’s test, because 


and 


for all r, by the ratio test. Differentiating the right side of (4.4.26) term by term yields the 
series 


which is the same as (4.4.26). Therefore, the differentiated series is also uniformly conver- 
gent on [—r, r] for every r, so the term by term differentiation is legitimate and 


E'(x) = E(x), -00 <x <o. 


This is not surprising if you recognize that E(x) = e*. 


Example 4.4.19 Failure to verify that the given series converges at some point can 
lead to erroneous conclusions. For example, differentiating 


X 
Y > cos = (4.4.27) 
n 


term by term yields 


which converges uniformly on [—r, r] for every r, since 


1.x |x| : 
ait |S oe (Exercise 2.3.19) 
n n 
es if <r, 
<5 if ixlsr 


and )°1/n? < oo. We cannot conclude from this that (4.4.27) converges uniformly on 
[—r, r]. In fact, it diverges for every x. (Why?) 


4.4 Exercises 


1. Find the set S on which { F;,,} converges pointwise, and find the limit function. 
(a) @) =x"(1 =x") (b) Fy(x) = nx" (1 — x?) 
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11. 


12. 


(c) Fa(x) = x"(1 — x") (d) Fi(x) = sin (1 4 ~) x 
(e) F,(x) = <= (f) Fir(x) = xsin = 
ie _ x. = —nx2 
(g) Fr(x) =n (1 = -) (h) Fr(x) =nxe 
: (x +7) 
ONS eae 


Prove: If {F,} converges to F on [a, b] and F, is nondecreasing for each n, then F 
is nondecreasing. 


Show that the functions { F;,} of Example 4.4.4 are integrable and F = limy—+oo Fy (x) 
is nonintegrable on every finite interval. 


Prove Lemma 4.4.2. 


Find F(x) = limp—+oo Fy(x) on S. Show that {F,,} converges uniformly to F on 
closed subsets of S, but not on S. 


(a) F,(x) =x"sinnx, S = (-1,1) 


(b) FQ) = 7a Sale Ath 
n* sin x 
(ce). BG) = Ty S = (0, oo) HINT: See Exercise 2.3.19. 
n?x 


(a) Show that if {F,,} converges uniformly on S, then {F,} converges uniformly 
on every subset of S. 

(b) Show that if {F,} converges uniformly on $1, S2, ..., Sm, then {F,} con- 
verges uniformly on );_, Sx. 

(c) Give an example where {F;,,} converges uniformly on each of an infinite se- 
quence of sets $1, S2,..., but not on Urey Sk. 


Describe the sets on which the sequences of Exercise 4.4.1 converge uniformly. Re- 
strict your attention to sets that are the union of finitely many intervals and singleton 
sets. 


Suppose that {F;,,} converges pointwise on [a, b] and, for each x in [a, b], there is 
an open interval /, containing x such that {F;,,} converges uniformly on J,  [a, 5]. 
Show that {F,,} converges uniformly on [a, 5]. 


Prove: If {F,} converges uniformly to F on S, then limy—oo || Fn|ls = || F'lls- 


Prove: If {F,} converges uniformly to F on S, then F is bounded on S if and only 
if limp—oo {|| Full} < 00. 

Prove: If {F,} and {G,} converge uniformly to F and G on S, then {Fy + Gn} 
converges uniformly to F + Gon S. 


(a) Prove: If {F,} and {G,} converge uniformly to bounded functions F and G 
on S, then {F;,,G,} converges uniformly to FG on S. 


13. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 
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(b) Give an example showing that the conclusion of (a) may fail to hold if F or 
G is unbounded on S. 


(a) Suppose that {F,,} converges uniformly to F on (a,b). Prove: If x9 <a <b 
and Ly = limy+x 9 Fn(x) exists (finite) for every n, then L = limy+oo Ln 
exists (finite) and 

lim F(x) = L. 
Xx>XO 


(b) State similar results for limits from the right and left. 


Find the limits. 


4 
d 
(a) lim " sin = dx (b) lim — 
noo 1 n noo o, L+x 
: —nx2 : x\" 
(6) im, f[ nxe™ dx (2) jim, (045) a 


Prove (without using Theorem 4.4.10): If each F, is integrable and { F,} converges 
uniformly on [a, 5], then limp—oo vi F,(x) dx exists. 


Prove (without using Theorem 4.4.10): If each F;, is nondecreasing and {F,,} con- 
verges uniformly to F on [a, b], then 


b b 
lim, | Fxddx = f F(x) dx. 


a 


Use Weierstrass’s test to determine sets on which the series converges absolutely 
uniformly. 


@) Dan (Fa) ©) Daa (tes) 
(c) Yo ax"(1— x)" (d) >> ea 


(e) 3 — Oy = ax 

n* (1 + x2)" 

Show that if }° |an| < oo, then }° a, cosnx and }° a, sinnx define continuous 
functions on (—oo, 00). 


(a) Give an example showing that the following “comparison test” is invalid: If 
> fn converges uniformly on S and ||gn|ls < || fulls, then >> gy converges 
uniformly on S. 

(b) This “comparison test” can be corrected by adding one word to its hypothesis 
and conclusion. What is the word? 


(a) Explain the difference between the following statements: (i) > f, converges 
absolutely and uniformly on S; (ii) >> fy converges absolutely uniformly 
on S. 
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(b) Show that if }* f, converges absolutely uniformly on S, then )> f, converges 
uniformly on S. 


21. Show that the hypotheses of Weierstrass’s test imply that )> f;, converges absolutely 
uniformly on S. 


22. Prove Corollary 4.4.17. 
23. Prove Theorem 4.4.18. 


24. Suppose that {a,}f° is monotonic and limy-+o9 dn = 0. Show that 


CO [o.e) 
) An sinnx and ) dn COSNX 
n=1 n=1 


define functions continuous for all x 4 2kx (k = integer). 
25. Prove Theorem 4.4.19. 
26. Formulate an analog of Theorem 4.4.10 for series. 
27. In Section 4.5 we will see that 
2n 


e* = ee and sinx = yey 
= n! (Qn+1)! 


2n+1 


n=0 


for all x, and in both cases the convergence is uniform on every finite interval. Find 
series that converge to 


* sint 


(a) Pays fo eP a and (b) Gx) = | —dt 
0 0 


t 


for all x. 
28. Prove Theorem 4.4.20. 


29. Show from Example 4.4.17 that )°°2_,(—1)” sin(x/n) converges uniformly on any 
finite interval. 


30. Prove: If 0 < dn41 < dp and yak < oo for some positive integer k, then 
>-(-1)” sinanx converges uniformly on any finite interval. 


31. Forn > 2, define 
n*(x—n+1/n?), n—-1f/n? <x <n, 
(Osteen l/r),. nee sn e1/e, 
0, |x —n| > 1/n3, 
and let F(x) = )°9°., fn(x). Show that [5° F(x) dx < oo, and conclude that ab- 


solute convergence of an improper integral ie F(x) dx does not imply that limy—o. F(x) = 
0, even if F is continuous on [0, co). 
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4.5 POWER SERIES 


We now consider a class of series sufficiently general to be interesting, but sufficiently 
specialized to be easily understood. 


Definition 4.5.1 An infinite series of the form 
le. ) 
Yo an(x — x0)". (4.5.1) 
n=0 


where x9 and do, a1, ..., are constants, is called a power series in x — Xo. | 


The following theorem summarizes the convergence properties of power series. 


Theorem 4.5.2 In connection with the power series (4.5.1), define R in the extended 
reals by 
1 —_ 
— = lim |a,|!/". (4.5.2) 
R noo 


1/n — 0, and R = 00 if limp +0 |dn|!/" = 0. Then 


In particular, R = 0 if limtn-+o0 |an| 

the power series converges 

(a) only for x = xo if R = 0; 

(b) forall x if R = 0x, and absolutely uniformly in every bounded set; 

(c) for x in (xo — R, x0 + R) if0 < R < ov, and absolutely uniformly in every closed 
subset of this interval. 


The series diverges if |x —xXo| > R. No general statement can be made concerning conver- 
gence at the endpoints x = x9 + Rand x = Xo — R: the series may converge absolutely 
or conditionally at both, converge conditionally at one and diverge at the other, or diverge 
at both. 


Proof In any case, the series (4.5.1) converges to do if x = xo. If 
So laale™< 00 (4.5.3) 


for some r > 0, then )>ayn(x — xo)” converges absolutely uniformly in [xo — r, xo + 
r], by Weierstrass’s test (Theorem 4.4.15) and Exercise 4.4.21. From Cauchy’s root test 
(Theorem 4.3.17), (4.5.3) holds if 


lim (lan |r")/" <1, 
n—-oo 


which is equivalent to 
r lim |a,|!/" <1 
n—-oo 


(Exercise 4.1.30(a)). From (4.5.2), this can be rewritten as r < R, which proves the 
assertions concerning convergence in (b) and (c). 


If0 < R < cand |x — xo| > R, then 
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1 1 

— > —— 

R- |x—Xo| 
so (4.5.2) implies that 


lea > 


S and therefore |a,(x — x0)”"| > 1 
|x — Xo| 


for infinitely many values of n. Therefore, }>an(x — xo)” diverges (Corollary 4.3.6) if 
|x — Xo| > R. In particular, the series diverges for all x 4 xo if R = 0. 


To prove the assertions concerning the possibilities at x = x9 + R andx = x9—R 
requires examples, which follow. (Also, see Exercise 4.5.1.) 0 


The number R defined by (4.5.2) is the radius of convergence of )~dn(x — xo)". If 
R > 0, the open interval (x9 — R, xo + R), or (—0o, co) if R = o, Is the interval of 
convergence of the series. Theorem 4.5.2 says that a power series with a nonzero radius 
of convergence converges absolutely uniformly in every compact subset of its interval of 
convergence and diverges at every point in the exterior of this interval. On this last we can 
make a stronger statement: Not only does )* ay (x — xo)” diverge if |x — xo| > R, but the 
sequence {a(x — xo)”} is unbounded in this case (Exercise 4.5.3(b)). 


Example 4.5.1 For the series 


3 snl _1y", 


we have 


noo gn 


: 1 
Tim Jay|!!" = Tim (Lsinax/6\""" 
n—->o tt 


— 
~ lim (|sinnz/6|)!/"__ (Exercise 4.1.30(a)) 
2, n—-0o 


1 1 
= 30 = >: 
Therefore, R = 2 and Theorem 4.5.2 implies that the series converges absolutely uniformly 
in closed subintervals of (—1, 3) and diverges if x < —1 or x > 3. Theorem 4.5.2 does not 
tell us what happens when x = —1 or x = 3, but we can see that the series diverges in both 


these cases since its general term does not approach zero. 
Example 4.5.2 For the series 
x” 
a 

_ eG 2 i 

lim ay’? = lim (<) = lim exp (= tos ~} =e =1, 

noo n—>oo\n noo n n 
Therefore, R = | and the series converges absolutely uniformly in closed subintervals 


of (—1, 1) and diverges if |x| > 1. For x = —1 the series becomes }\(—1)”/n, which 
converges conditionally, and at x = 1 the series becomes > 1/n, which diverges. | 
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The next theorem provides an expression for R that, if applicable, is usually easier to use 
than (4.5.2). 


Theorem 4.5.3 The radius of convergence of - an(x — Xo)" is given by 


an+1 
an 


if the limit exists in the extended reals. 


Proof From Theorem 4.5.2, it suffices to show that if 


iL. = ime |" (4.5.4) 
noo] An 
exists in the extended reals, then 
L = Tim |a,|!/". (4.5.5) 
n—->oo 


We will show that this is so if 0 < L < oo and leave the cases where L = 0 or L = & to 
you (Exercise 4.5.7). 


If (4.5.4) holds with 0 < L < oo and 0 < € < L, there is an integer N such that 


am+1 


L-eEe< <L+e if m=N, 


am 


sO 
lam|(L —€) < |dm4i| < |am[(L +6) if m2N. 


By induction, 
lan|(L—€)"% < |an| <|aw|\((Lt+e”% if n>N. 
Therefore, if 
K, =|an|(L—e)% and Kz = |ay|(L +e), 


then 
Red) 2 a2 SS, (4.5.6) 


Since limn—+oo K!/" = 1 if K is any positive number, (4.5.6) implies that 


1/n 1/n 


L—e< lim |a,| <Lte. 


< lim |ap| 
n—>oo noo 


Since € is an arbitrary positive number, it follows that 
lim |a,|'/" = L, 
n—->oo 


which implies (4.5.5). an) 
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Example 4.5.3 For the power series 
n 


y 


n!} . 1 
= lim —— = lim = 
noo (n + 1)! n>on+ 1 
Therefore, R = oo; that is, the series converges for all x, and absolutely uniformly in every 
bounded set. 


an 


Example 4.5.4 For the power series 


yaa, 


1)! 
a eee, ee 
n—-oo 


noo n! 


an+1 
an 


lim 


noo 


Therefore, R = 0, and the series converges only if x = 0. 


Example 4.5.5 Theorem 4.5.3 does not apply directly to 


Soe ae on = 
(p = constant), (4.5.7) 


4p ~ 
which has infinitely many zero coefficients (of odd powers of x). However, by setting 


y = x”, we obtain the series 


(=1)" 
ee (4.5.8) 
which has nonzero coefficients for which 


4" nP 1 a a 

at! = jim ——"—___ = = lim 1+—) =. 

an noo 4rt+l(n +1)? 4 n>00 4 
Therefore, (4.5.8) converges if |y| < 4 and diverges if |y| > 4. Setting y = x, we 
conclude that (4.5.7) converges if |x| < 2 and diverges if |x] > 2. Atx = +2, (4.5.7) 


becomes )>(—1)" /n”, which diverges if p < 0, converges conditionally if0 < p < 1, and 
converges absolutely if p > 1. 


Properties of Functions Defined by Power Series 


We now study the properties of functions defined by power series. Henceforth, we consider 
only power series with nonzero radii of convergence. 


Theorem 4.5.4 A power series 


f(x)= 3 an (x — X90)” 
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with positive radius of convergence R is continuous and differentiable in its interval of 
convergence, and its derivative can be obtained by differentiating term by term; that is, 


[o,) 
f'(x) = Yo nan (x — x0)", (4.5.9) 
n=1 
which can also be written as 
lo. ) 
f'@) = D5@ t+ Dansti& — x0)". (4.5.10) 
n=0 


This series also has radius of convergence R. 


Proof First, the series in (4.5.9) and (4.5.10) are the same, since the latter is obtained 
by shifting the index of summation in the former. Since 


lim ((n + D|an|)'/” = Tim (n + 1)!" Ian |'/” 
noo noo 


= ( lim (n + i") ( lim ja ("*) (Exercise 4.1.30(a)) 
n—-oo noo 


: log(n + 1) — iin e° 1 
7 im exp (mane (Tim lanl") => =z 
the radius of convergence of the power series in (4.5.10) is R (Theorem 4.5.2). Therefore, 


the power series in (4.5.10) converges uniformly in every interval [x9 — 7, Xo +r] such that 
0 <r < R, and Theorem 4.4.20 now implies (4.5.10) for all x in (xo — R, x9 + R). an 


Theorem 4.5.4 can be strengthened as follows. 


Theorem 4.5.5 A power series 


f(x) = Y) an (x = x0)" 
n=0 


with positive radius of convergence R has derivatives of all orders in its interval of convergence, 
which can be obtained by repeated term by term differentiation; thus, 


FOX) = Von = 1) (nk + Van (x — x0)". (4.5.11) 
n=k 


The radius of convergence of each of these series is R. 


Proof The proof is by induction. The assertion is true for k = 1, by Theorem 4.5.4. 
Suppose that it is true for some k > 1. By shifting the index of summation, we can rewrite 
(4.5.11) as 


oe) 


FO) = V+ hHat+k =D (2+ Vanse(x — x0)", [xX — x0] < R. 


n=0 
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Defining 
bh =(ntk)\n+k —-1)---( t+ lanse, (4.5.12) 


we rewrite this as 
lo.) 
FOG) a ye bn(x — x0)", |x—Xo| < R. 
=0 


By Theorem 4.5.4, we can differentiate this series term by term to obtain 


co 


frig) = So nbnalx Fig) |x —Xo0| < R. 


n=1 


Substituting from (4.5.12) for by yields 


fFtV (x) = Yia +khn+k—-1)---(1+ Dnadnag(x—x0)"1,  |x—x0| < R. 


n=1 


Shifting the summation index yields 


CO 
f¥ V(x) = » nia =1)=(= Da, =x)" ">... [Y= = R, 
n=k+1 
which is (4.5.11) with k replaced by k + 1. This completes the induction. q 


Example 4.5.6 In Example 4.4.10 we saw that 


CO 


i ee |x| <1. 


n=0 


— 


Repeated differentiation yields 


k! = 
oper = Dane) @—k+ Dar 
n=k 


= ith +k—-1)--@+ 0x", [x] <1, 


n=0 
so 
1 So [n+tk a 
aoe ("TE we 
n=0 
Example 4.5.7 By the method of Example 4.5.5, it can be shown that the series 
co x 2ntl ee x 2n 
S(x) = —1)" ————_ d C(x)= —1)" — 
(x) I Grape a C@) dA Y Omi 
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converge for all x. Differentiating yields 


so) = eo = T= C@) 


n=0 


and 
2n-1 n+1 


C'(x) = xe Y= =-Den eal Tc 
These results should not surprise you if you ean a 
S(x) =sinx and C(x) =cosx. 
(We will soon prove this.) | 


Theorem 4.5.5 has two important corollaries. 


Corollary 4.5.6 /f 
f@)= Yi antr—¥0) |x —xo0| < R, 


then 
f™ (xo) 


a 
n! 


Proof Setting x = xo in (4.5.11) yields 
f(x) = kag. 1 


Corollary 4.5.7 (Uniqueness of Power Series) /f 


[o.e) [o.e) 
So an(x — x0)" = Yo balx — x0)" (4.5.13) 
=0 n=0 
for all x in some interval (xp — 1, Xo +1), then 
an =byn, n=O. (4.5.14) 


Proof Let 
f(x) = pa dn(x —Xo)"” and g(x) = > by(x — Xo)”. 
n=0 n=0 


From Corollary 4.5.6, 
fe) 


(n) 
an = —— and by — &" Co) 


7 7 (4.5.15) 
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From (4.5.13), f = g in (xo —r, Xo +r). Therefore, 
f (x0) =o), n= 0. 


This and (4.5.15) imply (4.5.14). q 


Theorems 4.4.19 and 4.5.2 imply the following theorem. We leave the proof to you 
(Exercise 4.5.15). 


Theorem 4.5.8 /fx, and x2 are in the interval of convergence of 
Co 
f(x) = An(x — Xo)", 
=0 


then 


x2 oo 

an n+l n+l 

x)dx = x2 — Xo — (x1 — Xo : 

[Oo fenas = [eee — x0)" = 651 = 20") 
1 n=0 

that is, a power series may be integrated term by term between any two points in its interval 

of convergence. 


Example 4.5.16 presents an application of this theorem. 


Taylor’s Series 


So far we have asked for what values of x a given power series converges, and what are 
the properties of its sum. Now we ask a related question: What properties guarantee that a 
given function f can be represented as the sum of a convergent power series in x — x9? A 
partial answer to this question is provided by what we already know: Theorem 4.5.5 tells us 
that f must have derivatives of all orders in some neighborhood of xo, and Corollary 4.5.6 
tells us that the only power series in x — xo that can possibly converge to f in such a 
neighborhood is 


oO £(n) 
n=0 : 


This is called the Taylor series of f about Xo (also, the Maclaurin series of f ,if x9 = 0). 
The mth partial sum of (4.5.16) is the Taylor polynomial 


m ¢(n) 
ina) =>" OO — x0)”, 
n=0 . 


defined in Section 2.5. 


The Taylor series of an infinitely differentiable function f may converge to a sum dif- 
ferent from f. For example, the function 
ex? x # 0, 


fay = 46 nes 
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is infinitely differentiable on (—00, 00) and f (0) = 0 for n > 0 (Exercise 2.5.1), so its 


Maclaurin series is identically zero. 


The answer to our question is provided by Taylor’s theorem (Theorem 2.5.4), which 
says that if f is infinitely differentiable on (a, b) and x and xo are in (a, b) then, for every 


integer n > 0, 
gery) (cn) 


@ +i)! (x — xo)", 


I (x) — Thx) = 


where cy, is between x and xg. Therefore, 
[o.@) 
f™ (xo) 
f(x) =) (e — x0)" 
n=0 i 


for an x in (a, b) if and only if 


FRM) 


c _ n+1 _ 
oo Gait : 


(4.5.17) 


It is not always easy to check this condition, because the sequence {cy} is usually not pre- 
cisely known, or even uniquely defined; however, the next theorem is sufficiently general 


to be useful. 


Theorem 4.5.9 Suppose that f is infinitely differentiable on an interval I and 


Ae 
lim —|| f [lr = 0. 
n>o n! 
Then, if Xo € T°, the Taylor series 


oO F(n) 
a : 0) — x0)” 


n=0 
converges uniformly to f on 


I, =I N[xo—1r,x0 +7]. 


Proof From (4.5.17), 


n+1 n+1 


een i= 


r r 
—(n+D! 


(n+1) 
a IFO, 


If —Tnllz < 


so (4.5.18) implies the conclusion. 


Example 4.5.8 If f(x) = sinx, then || f™ ||(-c0,00) = 1, k = 0. Since 


r? 
lim —=0, O0<r<o©o 
n—>oo n! 


(4.5.18) 
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(Example 4.1.12), (4.5.18) holds for all 7. Since 
fEMO) =0 and FO") =(-1)", mz, 
we see from Theorem 4.5.9, with J = (—oo, 00), x9 = 0, and r arbitrary, that 
2n+1 


[o.@) 
x 
snx = a Qa+D! —-wO <xX¥ < QW, 


and the convergence is uniform on bounded sets. 
A similar argument shows that 


sed 2n 


cosx = yon" oar —0o < x < 00, 


n=0 
with uniform convergence on bounded sets. 


Example 4.5.9 If f(x) = e*, then f(x) = e* and || f ||; = e’, k > 0, if 


I =[-7,r]. Since 
n 


ee 
lim —e =0, 
we conclude as in Example 4.5.8 that 
x = x" 
e == 0 <x<o, 
“=n! 


with uniform convergence on bounded sets. 


Example 4.5.10 If f(x) = (1 +. x)4, then 


(n) (n) 
FPR) (‘) eer eg 2 Os (‘) (4.5.19) 


n! n! n 


(Example 2.5.3). The Maclaurin series 


x (0) 


is called the binomial series. We saw in Example 2.5.3 that this series equals (1 + x)? for 
all x if g is a nonnegative integer. We will now show that if g is an arbitrary real number, 
then 


CO 


ye (‘) = = f(x)=(4+x)!, O<x <1. (4.5.20) 


n=0 


Since 


Section 4.5 Power Series 267 


q-n 


=]. 
n+1 


= lim 
aco 


lim 
n—-oo 


(.2,)/( 


the radius of convergence of the series in (4.5.20) is 1. From (4.5.19), 


naw Ilfo,1) q 
n 


n!} 
n 
fim —||f IIo, < [max(1,2%)] lim 
n>oo n! : noo 


< [max(1, 27)] , n>o. 


Therefore, if 0 < r < 1, 


where the last equality follows from the absolute convergence of the series in (4.5.20) on 
(—1, 1). Now Theorem 4.5.9 implies (4.5.20). isi 


We cannot prove in this way that the binomial series converges to (1 + x)% on (—1, 0). 
This requires a form of the remainder in Taylor’s theorem that we have not considered, or 
a different kind of proof altogether (Exercise 4.5.20). The complete result is that 


(l+x)f = > (") =< x <1, (4.5.21) 


n=0 


for all g, and, as we said earlier, the identity holds for all x if g is a nonnegative integer. 


Arithmetic Operations with Power Series 


We now consider addition and multiplication of power series, and division of one by an- 
other. 


We leave the proof of the next theorem to you (Exercise 4.5.21). 


Theorem 4.5.10 If 


CO 
FQ) = Doane — x0)", [x - x0] < Ri, (4.5.22) 
n=0 
lo, ) 
(x) = bal — x0)", |x — x0] < Ro, (4.5.23) 
n=0 
and a and B are constants, then 
lo) 
af (x) + Bg(x) = Y\(@an + Bbn)(x — x0)", |x — x0] < R, 
n=0 


where R > min{R1, R2}. 
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Theorem 4.5.11 If f and g are given by (4.5.22) and (4.5.23), then 
F(x)g(x) = > Cn(x — X09)", |x—xo| < R, (4.5.24) 


where 
Ch = y arbn—-r = y An—r by 
r=0 r=0 


and R > min{R,, Ro}. 


Proof Suppose that R; < R2. Since the series (4.5.22) and (4.5.23) converge abso- 
lutely to f(x) and g(x) if |x — xo| < R1, their Cauchy product converges to f(x)g(x) if 
|x —xXo| < Ri, by Theorem 4.3.29. The nth term of this product is 


ae — x0)" bar (x — X90)" 7 = = (Soa 1 ) (x — x0)” = cn(x — xo)”. 


r=0 r=0 
Example 4.5.11 If 


1 CO 
f®= 75 =)" |x| <1, 


n=0 
and 
co 
g(x) = So bax”, |x| < R, 
then 
se) = Sse" _ |x| <min{1, R}, 
where 


Sn = (Ibo + C)b1 +--+ + Abn 
= bo + by +++ +bn. 


Example 4.5.12 From the paragraph following Example 4.5.10, 


(+x)? = a (?)" |x| <1, 


n=0 


(+.x)% = » (")». |x| <1. 


n=0 
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Since 


n 


(+x)Pd+x)f=4+x)?t =) > ( ial 


n=0 


while the Cauchy product is )-7° 9 Cnx”, with 


“-E()(4) 


Corollary 4.5.7 implies that 
This yields the identity 


valid for all p and q. | 
The quotient 
f(x) = —— (4.5.25) 


of two power series 


lo. e) 
h(x) = yy Cn(x — x0)", |x —xo| < Ri, 
n=0 
and 


Co 
g(x) =) ba(x— x0)", |x — x0] < Ra, 
=0 
can be represented as a power series 
Co 
f(x) = Yo an(x — x0)" (4.5.26) 
n=0 


with a positive radius of convergence, provided that 


bo = g(xo) #0. 


This is surely plausible. Since g(xo) # 0 and g is continuous near xo, the denominator 
of (4.5.25) differs from zero on an interval about x9. Therefore, f has derivatives of all 
orders on this interval, because g and h do. However, the proof that the Taylor series of f 
about xo converges to f near xo requires the use of the theory of functions of a complex 
variable. Therefore, we omit it. However, it is straightforward to compute the coefficients 
in (4.5.26) if we accept the validity of the expansion. Since 


F(x)g(x) = A(x), 
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Theorem 4.5.11 implies that 
n 
> arbn-> =Cn, n=O. 
=0 


Solving these equations successively yields 


1 n—-1 
an = be («. -Y bert] , n>. 


It is not worthwhile to memorize these formulas. Rather, it is usually better to view the 
procedure as follows: Multiply the series f (with unknown coefficients) and g according 
to the procedure of Theorem 4.5.11, equate the resulting coefficients with those of h, and 
solve the resulting equations successively for do, a1, .... 


Example 4.5.13 Suppose that we wish to find the coefficients in the Maclaurin series 
tanx = do t+a1x +agx74+---. 


We first observe that since tan x is an odd function, its derivatives of even order vanish at 
Xo = 0,80 d2m = 0,m => 0. Therefore, 


tan x = a,x + 04x? + asx” See 


Since . 
sin x 
tanx = 
OS xX 
it follows from Example 4.5.8 that 
x3 x? 
Xx + + 
a,x +a3x° +asx°4+---= 6 120 
x x 
1- 4 
2 a 24 + 


sO 


4 5 a. x. 
(a,x + a3x + asx +---) ae ag eee =x-—+—+°::,7 


or, according to Theorem 4.5.11, 


a a a 
ax + (a3-D)x9+(as—F 4+ B)et--ax- Ste. 


From Corollary 4.5.7, coefficients of like powers of x on the two sides of this equation 
must be equal; hence, 
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Therefore, 


x3 


ag Aes 
anx =X 3 15” . 


Example 4.5.14 To find the reciprocal of the power series 
[oe x 
= a aa 
g(x) =1+e cag = 
n= 


we let h = 1 in (4.5.25). If 


1 CO 
—_ = Dm anx", 
Ba) 2 


then 


ee a 
1 = (do tax tans? bast te) (24r+ bo +) 


a 
= 2do + (do + 2a1)x + (> +a,+ 2a2) - 


a a 

+(2+ + a2 + 2a3) x9 $0. 
6 2 

From Corollary 4.5.7, 


2dao = 1, 
dag + 2a; = 0, 

ao 
3 +4 +2a2=0, 
4 SD 4 ay +203 =0 
6 5) a2 az =U. 


Solving these equations successively yields 


1 
ag = 7 
ao 1 
aq S =, 
: 7, 4 


sO 


271 
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Example 4.5.15 To find the reciprocal of 


[e.e) xn 
a ae 
g(x) =e* = DO, (4.5.27) 
n= 
we again let h = 1 in (4.5.25). If 
[e,@) 
@ 7 =) max", 
n=0 
then 
[o.@) [o,e) x CO 
l= (3>ans"} (> =| = ye ; 
n=0 n=0 n=0 
where 


From Corollary 4.5.7, co = do = | and cy, = O ifn = 1; hence, 


n-1 
ar 
an =- >> Gopr "2h (4.5.28) 
r=0 
Solving these equations successively for dg, a1, ... yields 


1 
a= =e ==], 


1 1 1 
az = — Eo er a] => 


From this, we see that 


for 0 <k < 4 and are led to conjecture that this holds for all k. To prove this by induction, 
we assume that it is so for 0 < k <n — 1 and compute from (4.5.28): 


n-1 1 (-1)" 
= @@—n! 7! 


= (Exercise 1.2.19(b)). 
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Thus, we have shown that 


[o) xn 
x\-1 _ yn t_ 
eye Dep 
n=0 
Since this is precisely the series that results if x is replaced by —x in (4.5.27), we have 
verified a fundamental property of the exponential function: that 


(e*)~ = eo, 


This also follows from Example 4.3.26. 


Abel’s Theorem 


From Theorem 4.5.4, we know that a function f defined by a convergent power series 
[o) 
F(x) = Yo an(x — x0)", |x — x0] < R, (4.5.29) 
=0 


is continuous in the open interval (xp — R, x9 + R). The next theorem concerns the behavior 
of f as x approaches an endpoint of the interval of convergence. 


Theorem 4.5.12 (Abel’s Theorem) Let f be defined by a power series (4.5.29) 


with finite radius of convergence R. 
(a) If ey an R” converges, then 


lim f(x) = Yo anR". 
n=0 


x—>(x9+R)— 


(b) If 02.9 (—1)" an R" converges, then 


x—>(xo—R)+ 


lo.) 
lim f(x) = )/(-1)"anR”. 
n=0 
Proof We consider a simpler problem first. Let 


g(y) = >> bay” 
=0 


and 
[oe 


So bn =s (finite). 


n=0 
We will show that 
lim gO) =s. (4.5.30) 
yrol- 
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From Example 4.5.11, 


[o,e) 
g(vy) =(1-y) Do ny”, (4.5.31) 
n=0 
where 
Sn = bo + by +--+ + dn. 
Since 
1 = ee 
<7 yy" and therefore 1=(1—y)} oy", yl <1, (4.5.32) 
n=0 n=0 


we can multiply through by s and write 


[o.@) 
s=(1-y) osy", [yl <1. 


n=0 


Subtracting this from (4.5.31) yields 


gy) -s=(1-y) Ga -s)y", ly] <1. 


n=0 


If « > 0, choose N so that 
lsn -s|<e€ if n>N+1. 


Then, if0 < y < 1, 


N lee) 
Is@) -s|<Q-y) ola —sly"+0-y¥) DO lon —sly” 


n=0 n=N+1 

N [eve) 
<(1—y) >) |sn — sly" + — yey? D> y" 

n=0 n=0 


N 
<(l-y)> > Sn —S| +, 
=0 


because of the second equality in (4.5.32). Therefore, 


lg(y) —5| < 2e 


N 
(1=y) Vins] <e. 


n=0 
This proves (4.5.30). 
To obtain (a) from this, let b, = a,R” and g(y) = f(xo + Ry); to obtain (b), let 
bn = (—1)"ay, R" and g(y) = f(xo — Ry). q 
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Example 4.5.16 The series 


f@)= 


1 Cc 
l+x ae 


n=0 


diverges at x = 1, while lim,_,;— f(x) = 1/2. This shows that the converse of Abel’s 
theorem is false. Integrating the series term by term yields 


iad n+1 
1 


log +x) = D\(-"= 


|x| < 1, 
n=0 ny 
where the power series converges at x = 1, and Abel’s theorem implies that 


oo (-1)?*1 
log2 = ———_. 
7 dX n+1 


Example 4.5.17 If q = 0, the binomial series 


x (0)° 


converges absolutely for x = +1. This is obvious if g is a nonnegative integer, and it 
follows from Raabe’s test for other positive values of g, since 


Ant+1} _ q q\|_ "ud 
= = —, n>gq, 
an n+1 n 1 
and 
tim.» (| =1) = tim n (4 - ) 
n—>oo an n—>oo n+1 
n 


II 


n>oon + 


Therefore, Abel’s theorem and (4.5.21) imply that 


> () =2% and ZY () =0, q>0. 


4.5 Exercises 


1. The possibilities listed in Theorem 4.5.2(c) for behavior of a power series at the 
endpoints of its interval of convergence do not include absolute convergence at one 
endpoint and conditional convergence or divergence at the other. Why can’t these 
occur? 
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2. Find the radius of convergence. 


(a)>- (* + -) [2+(-1)"]" x" = (b) H2¥*@ - 1)" 


n 


(c) > (2 + sin my (x +2)" (d) Snv7x" 


OxG) 


3. (a) Prove: If {a,r”} is bounded and |x; — xo| < r, then > an(x1 — xo)” con- 
verges. 
(b) Prove: If }*an(x — xo)” has radius of convergence R and |x; — xo| > R, 
then {dy (x1 — Xo)"} is unbounded. 
4. Prove: If g is a rational function defined for all nonnegative integers, then }° a,x” 
and )> dn g(n)x” have the same radius of convergence. HINT: Use Exercise 4.1.30(a). 
5. Suppose that f(x) = >> an(x — xo)” has radius of convergence R and0 <r < 
R, < R. Show that there is an integer k such that 


r k+1 Ri 
<i 
~ Ry Ry =f 


k 
f(x) — Yo an (x — x0)" 


n=0 


if |x —xo| <randk >k. 


6. Suppose that k is a positive integer and 
Cc 
(=> ae 
n=0 
has radius of convergence R. Show that the series 


8) =f )= ) aa 


n=0 
has radius of convergence R!/*. 
7. Complete the proof of Theorem 4.5.3 by showing that 
(a) R =O if limp co lan+1|/lan| = 00; 
(b) R =o if limp soo |an4i|/|an| = 0. 


8. Find the radius of convergence. 


(a) S(ogn)x" (b) D2" +" 
2 24] 
(c) ey" ( ys (4) Nee - 1" 
n” A a(a+1)---(@+n-1) , 
(e) > wot (f) >> BB+) (b4n-)* 


(a, B 4 negative integer) 


10. 


11. 


12. 


13. 


14. 


15. 
16. 
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Suppose that a, ~ 0 forn sufficiently large. Show that 


(a) lim sala lim |a,|/" and (b) Tim |a,|!/" < Tim | 
n—oo| An n->0o noo noo! An 
Show that this implies Theorem 4.5.3. 
Given that 
1 Co 
= n 
tao = pee ; |x| < 1, 
n=0 
use Theorem 4.5.4 to express }“P°.9 17x” in closed form. 
The function 
CO 
_ (-1)" x\2nt+P 
Jp(x) = z AG (5) (p = integer > 0) 
is the Bessel function of order p. Show that 
(a) Jj = —Jj. 
(b) J, = 5(p-1 —Jpti), p= 1. 
(c) x7J¥ + xd, + (x? — p?)Jp = 0. 
Given that the power series f(x) = )°72.9 dnx” satisfies 
f(x) = -2xf(x), fO)=1, 
find {an}. Do you recognize f? 
Let 
oe) 
fx) = Yoanx", xl <R, 
n=0 
and g(x) = f(x*), where k is a positive integer. Show that 
kn)! 
e(0)=0 if r#kn and g*) = En" £0), n>0. 
n! 


Let 
lo) 
f(x)= Se an(x —xo)", |x—xo| < R, 
=0 


and f(t,) = 0, where t, ~ Xo and limy+ootn = Xo. Show that f(x) = 0 
(|x — xo| < R). HINT: Rolle’s theorem helps here. 


Prove Theorem 4.5.8. 
* logt 
/ 0 dt 
1 t-l 


Express 
as a power Series in x — | and find the radius of convergence of the series. 
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17. 


18. 


19. 


20. 


21. 
22. 


23. 


24. 


25. 


26. 


By substituting —x? for x in the geometric series, we obtain 


ae =r 1". el =. 


Use this to express f(x) = Tan~!x (f(0) = 0) as a power series in x. Then 
evaluate all derivatives of f at x9 = 0, and find a series of constants that converges 
to 1/6. 


Prove: If 
f(x) = Dont =)" |x —xo| < R, 


and F is an antiderivative of f on (xo — R, Xo + R), then 


n+l 
’ 


F(x) = c+ j & — Xo) |x —xo0| < R, 


where C is a constant. 


Suppose that some derivative of f can be represented by a power series in x — xo 
in an interval about x9. Show that f and all its derivatives can also. 


Verify Eqn. (4.5.21) by showing that 


o) 
(+x)4% a (1) =1, |x| <1, 


n=0 
HINT: Differentiate. 
Prove Theorem 4.5.10. 


Find the Maclaurin series of cosh x and sinh x from the definition in Eqn. (4.5.16), 
and also by applying Theorem 4.5.10 to the Maclaurin series for e* and e ~. 


Give an example where the radius of convergence of the product of two power series 
is greater than the smaller of the radii of convergence of the factors. 


Use Theorem 4.5.11 to find the first four nonzero terms in the Maclaurin. 


(a) e*sinx (b) (c) SS (d) (sin x) log(1 + x) 


e~ 
1+ x? 
Derive the identity 
2sinx cosx = sin2x 


from the Maclaurin series for sin x, cos x, and sin2x. 
(a) Given that 


(1—2xt +x)? = = tos" |x| <1, (A) 


27. 


28. 


29. 


30. 


31. 
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if—1 <t < 1, show that Po(t) = 1, Pi (t) = t, and 


2n+1 
Pa4i(t) = ii I tPn(t) — Pr—-1(t), n=l, 


HINT: First differentiate (A) with respect to x. 


(b) Show from (a) that P, is a polynomial of degree n. It is the nth Legendre 
polynomial, and (1 —2xt + x?)~'/? is the generating function of the sequence 


{Pr}. 


Define (if necessary) the given function so as to be continuous at x9 = 0, and find 
the first four nonzero terms of its Maclaurin series. 


COS X 


(a) ~ Sag (b) rarer (c) sec x 
sin 2x 
(d) x csc x (e) paws 


Let dg = ay = 5S and dy41 = Gn — 64n-1, n = 1. 

(a) Express F(x) = }°?2.9 anx” in closed form. 

(b) Write F as the difference of two geometric series, and find an explicit formula 
for dn. 


Starting from the Maclaurin series 
log —x) = -)— = 


use Abel’s theorem to evaluate 


ayes) ES cee 


In Example 4.5.17 we saw that 
CO 
» (’) = 27, q=0. 
n 
n=0 


Show that this also holds for —1 < q < 0, but not for g < —1. HINT: See Exer- 
cise 4.1.35. 


(a) Prove: If )°?2.9 bn converges, then the series g(x) = )-72.9 bnx” converges 
uniformly on [0, 1]. HINT: [fe > 0, there is an integer N such that 


lbn tbngi tes: +bm| <e if nym>N. 
Use summation by parts to show that then 
(Bue bye doer ban ete af OR 1, Ame, 


This is also known as Abel’s theorem. 
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32. 


33. 


34. 


(b) Show that (a) implies the restricted form of Theorem 4.5.12 (concerning g) 
proved in the text. 


Use Exercise 4.5.31 to show that if alt an, pa bn, and their Cauchy product 
9 Cn all converge, then 


Prove: If 


CO 
g(x) = yb", |x| <1, 
=0 


and b, > 0, then 


[o,) 
So bn a lim g(x) (finite or infinite). 
x—>1- 


n=0 
Use the binomial series and the relation 


d 
—(sin-' x) =(1- x72)? 
dx 


to obtain the Maclaurin series for sin~! x (sin! 0 = 0). Deduce from this series 
and Exercise 4.5.33 that 


eo 2n 1 _ a 
n}227Q2Qn+1) 2° 


n=0 


CHAPTER 5 


Real-Valued Functions 


of Several Variables 


IN THIS CHAPTER we consider real-valued function of n variables, where n > 1. 


SECTION 5.1 deals with the structure of IR”, the space of ordered n-tuples of real numbers, 
which we call vectors. We define the sum of two vectors, the product of a vector and a 
real number, the length of a vector, and the inner product of two vectors. We study the 
arithmetic properties of R”, including Schwarz’s inequality and the triangle inequality. We 
define neighborhoods and open sets in R”, define convergence of a sequence of points in 
IR”, and extend the Heine—Borel theorem to R”. The section concludes with a discussion 
of connected subsets of R”. 


SECTION 5.2 deals with boundedness, limits, continuity, and uniform continuity of a func- 
tion of n variables; that is, a function defined on a subset of R”. 


SECTION 5.3 defines directional and partial derivatives of a real-valued function of n 
variables. This is followed by the definition of differentiablity of such functions. We define 
the differential of such a function and give a geometric interpretation of differentiablity. 


SECTION 5.4 deals with the chain rule and Taylor’s theorem for a real-valued function of 
n variables. 


5.1 STRUCTURE OF R® 


In this chapter we study functions defined on subsets of the real n-dimensional space R”, 
which consists of all ordered n-tuples X = (x1, X2,...,Xn) of real numbers, called the 
coordinates or components of X. This space is sometimes called Euclidean n-space. 


In this section we introduce an algebraic structure for R”. We also consider its topologi- 
cal properties; that is, properties that can be described in terms of a special class of subsets, 
the neighborhoods in R”. In Section 1.3 we studied the topological properties of R!, which 
we will continue to denote simply as R. Most of the definitions and proofs in Section 1.3 
were stated in terms of neighborhoods in R. We will see that they carry over to R” if the 
concept of neighborhood in R” is suitably defined. 
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Members of R have dual interpretations: geometric, as points on the real line, and alge- 
braic, as real numbers. We assume that you are familiar with the geometric interpretation 
of members of R? and R? as the rectangular coordinates of points in a plane and three- 
dimensional space, respectively. Although R” cannot be visualized geometrically ifn > 4, 
geometric ideas from R, R?, and R? often help us to interpret the properties of R” for 
arbitrary n. 

As we Said in Section 1.3, the idea of neighborhood is always associated with some 
definition of “closeness” of points. The following definition imposes an algebraic structure 
on R”, in terms of which the distance between two points can be defined in a natural way. 
In addition, this algebraic structure will be useful later for other purposes. 


Definition 5.1.1 The vector sum of 


X = (%1,%2,...,Xn) and Y= (jj, yo,..., Vn) 


X+ Y = (41 + y1,%2 + y2,...,%n + Yn). (5.1.1) 


If a is areal number, the scalar multiple of X by a is 


aX = (4x1, aX2,...,aXn). (5.1.2) 
|_| 


Note that “+” has two distinct meanings in (5.1.1): on the left, “+” stands for the newly 
defined addition of members of R” and, on the right, for addition of real numbers. However, 
this can never lead to confusion, since the meaning of “+” can always be deduced from 
the symbols on either side of it. A similar comment applies to the use of juxtaposition to 
indicate scalar multiplication on the left of (5.1.2) and multiplication of real numbers on 
the right. 


Example 5.1.1 InR’, let 
X = (1,-2,6,5) and Y= (3,—-5,4,4). 


Then 
X+Y = (4,-7, 10, +) 


and 
6X = (6, —12, 36, 30). | 


We leave the proof of the following theorem to you (Exercise 5.1.2). 
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Theorem 5.1.2 IfX, Y, and Z are in R" anda and b are real numbers, then 

(a) X+Y=Y+X (vector addition is commutative). 

(b) (X+Y)+Z=X+4(¥ + Z) (vector addition is associative). 

(c) There is a unique vector 0, called the zero vector, such that X + 0 = X for all X in 
R”. 

(d) For each X in R" there is a unique vector —X such that X + (—X) = 0. 

(e) a(bX) = (ab)Xx. 

(f) (a@+b)X =aX+ bX. 

(g) a(X+Y) =aX+ayY. 

(h) 1X=X. 


Clearly, 0 = (0,0,...,0) and, if X = (x1, X2,..., Xn), then 
—X = (—x1,—X2,...,—Xn). 


We write X + (—Y) as X — Y. The point 0 is called the origin. 


A nonempty set V = {X, Y, Z,...}, together with rules such as (5.1.1), associating a 
unique member of V with every ordered pair of its members, and (5.1.2), associating a 
unique member of V with every real number and member of V, is said to be a vector space 
if it has the properties listed in Theorem 5.1.2. The members of a vector space are called 
vectors. When we wish to emphasize that we are regarding a member of R” as part of this 
algebraic structure, we will speak of it as a vector; otherwise, we will speak of it as a point. 


Length, Distance, and Inner Product 


Definition 5.1.3 The length of the vector X = (x1, X2,...,Xn) is 
|X| = ie + x5 +--- oe 


The distance between points X and Y is |X — Y]; in particular, |X| is the distance between 
X and the origin. If |X| = 1, then X is a unit vector. a 


Ifn = 1, this definition of length reduces to the familiar absolute value, and the distance 
between two points is the length of the interval having them as endpoints; for n = 2 and 
n = 3, the length and distance of Definition 5.1.3 reduce to the familiar definitions for the 
plane and three-dimensional space. 


Example 5.1.2 The lengths of the vectors 


X = (1,—2,6,5) and Y = (3,-5, 4,3) 


[X| = (1? + (2)? + 6? +. 57)'/? = 66 
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and 
V201 
2 2 2 1\2)1/2 
|Y| = (3? + (5)? +4 + §))"/ = 
The distance between X and Y is 
V/ 149 
X-¥|= (1-37 +245 + 6-47 + 6-5)? = ——. 


Definition 5.1.4 The inner product X-Y¥ of X = (x1, X2,...,X%n) and Y = (j1, y2,..-, Yn) 
is 
X-Y = x1 y1 + X22 ++++ + Xnyn. 


Lemma 5.1.5 (Schwarz’s Inequality) Jf X and Y are any two vectors in R", 
then 
[X-¥| < |X| |Y|, (6:13) 


with equality if and only if one of the vectors is a scalar multiple of the other. 


Proof If Y = 0, then both sides of (5.1.3) are 0, so (5.1.3) holds, with equality. In this 
case, Y = 0X. Now suppose that Y # 0 and ¢ is any real number. Then 


O< Soi —tyi) 


eta n n 
= Sox? Vu +2? (5.1.4) 
i=1 i=1 i=1 


= |X|? —2(K-Y)r +7 |Y/2. 


The last expression is a second-degree polynomial p int. From the quadratic formula, the 
zeros of p are 
|, &Y) + VK-¥P = RPIYP 
[¥|? , 


Hence, 
(K-Y)? < [X/7/¥/?, (5.1.5) 


because if not, then p would have two distinct real zeros and therefore be negative between 
them (Figure 5.1.1), contradicting the inequality (5.1.4). Taking square roots in (5.1.5) 
yields (5.1.3) if Y 4 0. 

If X = tY, then |K-¥| = [X||¥| = |¢|/Y|? (verify), so equality holds in (5.1.3). 
Conversely, if equality holds in (5.1.3), then p has the real zero t9 = (X - Y)/|Y||?, and 


n 
Yi -toyi)? =0 


i=1 


from (5.1.4); therefore, X = to Y. an 
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> t 


Figure 5.1.1 


Theorem 5.1.6 (Triangle Inequality) /fX and Y are in R", then 
[X+ ¥| < |X] + |¥I, (5.1.6) 


with equality if and only if one of the vectors is a nonnegative multiple of the other. 


Proof By definition, 


n n n n 
IX+¥)? = (ai + yi)? = Dox? +2 xii + D9? 


i=1 i=1 i=1 i=1 


= |X|? + 2(K-Y) + |Y¥/? (5.1.7) 
< |X|? + 2|X||/¥|+]¥|? (by Schwarz’s inequality) 
= (|X| + |¥|)?. 
Hence, 
IX + ¥/? < (X| + [¥))*. 
Taking square roots yields (5.1.6). 


From the third line of (5.1.7), equality holds in (5.1.6) if and only if X- Y = |X||Y|, 
which is true if and only if one of the vectors X and Y is a nonnegative scalar multiple of 
the other (Lemma 5.1.5). 0 


Corollary 5.1.7 If X, Y, and Z are in R", then 
[X—Z| < |K-Y|+|Y-—Z|]. 


Proof Write 
X-Z=(X-Y)+(Y-2), 


and apply Theorem 5.1.6 with X and Y replaced by X — Y and Y — Z. 0 


286 Chapter 5 Real- Valued Functions ofn Variables 


Corollary 5.1.8 /[fX and Y are in R", then 
[X—Y| > ||[X| —|Y¥]]. 
Proof Since 
X=Y+(X-Y), 


Theorem 5.1.6 implies that 
X| < |¥|+|xX—YI, 


which is equivalent to 
X| —|Y| < |X— Y}. 


Interchanging X and Y yields 


Y| — |X| < /Y — Xj. 
Since |K — Y| = |Y¥ — X], the last two inequalities imply the stated conclusion. an 


Example 5.1.3 The angle between two nonzero vectors X = (x1,X2,x3) and Y = 
(1, 2, Y3) in R3 is the angle between the directed line segments from the origin to the 
points X and Y (Figure 5.1.2). 


x 
1X1 
0 
IX-YI 
lY| 
Y 


Figure 5.1.2 


Applying the law of cosines to the triangle in Figure 5.1.2 yields 
|X — Y|? = |X|? + |¥|? — 2|X||¥| cos 6. (5.1.8) 
However, 
[X —Y|? = (x1 — y1)? + (x2 — yo)? + (x3 — v3)” 
= (xf +23 +23) + OT +92 + y3) — 2Gy1 + X2y2 + X33) 
= |X|? + |Y¥|? -2x-Y. 
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Comparing this with (5.1.8) yields 
X-Y = |X||Y| cos 0. 
Since | cos 6| < 1, this verifies Schwarz’s inequality in R?. 


Example 5.1.4 Connecting the points 0, X, Y, and X + Y in R? or R? (Figure 5.1.3) 
produces a parallelogram with sides of length |X| and |Y| and a diagonal of length |X + Y]. 


Figure 5.1.3 


Thus, there is a triangle with sides |X|, |Y|, and |X + Y|. From this, we see geometrically 
that 


\X + Y| < |X|+|¥| 


in R? or R3, since the length of one side of a triangle cannot exceed the sum of the lengths 
of the other two. This verifies (5.1.6) for R? and R? and indicates why (5.1.6) is called the 
triangle inequality. | 


The next theorem lists properties of length, distance, and inner product that follow di- 
rectly from Definitions 5.1.3 and 5.1.4. We leave the proof to you (Exercise 5.1.6). 


Theorem 5.1.9 /fX, Y, and Z are members of R" anda is a scalar, then 
(a) aX| = lal IX. 

(b) |X| => 0, with equality if and only ifX = 0. 

(c) |X—Y| = 0, with equality if and only if X = Y. 

(d) X-Y=Y-X. 

(e) X-(Y+Z)=X-Y+X-Z. 

(f) (cX)-Y =X-(cY) =c(X-Y). 
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Line Segments in R® 


The equation of a line through a point Xo = (Xo, yo, Zo) in R? can be written parametri- 
cally as 


X=Xotuit, y=yotuat, Z=Zotu3t, -wK<t<w, 
where 1/1, %2, and v3 are not all zero. We write this in vector form as 
X=X)+tU, -w<t<wo, (5.1.9) 


with U = (v1, U2, 3), and we say that the line is through Xo in the direction of U. 


There are many ways to represent a given line parametrically. For example, 
X=Xo+5sV, -o<s<o, (5.1.10) 


represents the same line as (5.1.9) if and only if V = aU for some nonzero real number a. 
Then the line is traversed in the same direction as s and ¢t vary from —oo to oo if a > 0, or 
in opposite directions if a < 0. 


To write the parametric equation of a line through two points Xo and X, in R?, we take 
U = X, — 0in (5.1.9), which yields 


X = Xo + t(K; — Xo) = tX1 + (1 —-1t)X0, -co<t<o. 


The line segment from Xo to X; consists of those points for which 0 < ¢ < 1. 


Example 5.1.5 The line L defined by 
x=-14+2t, y=3-4t, z=-l, -w<t<o, 
which can be rewritten as 
X = (-1,3,-1) + 7(2,-4,0), -—co<t <oo, (5.1.11) 


is through Xp = (—1,3,-—1) in the direction of U = (2,—4,0). The same line can be 
represented by 

X = (-1,3,-1) +5(1,-2,0), -co<s<wo, (5.1.12) 
or by 

X = (—1,3,-1) + t(—4, 8,0), -oo < Tt < oo. (5.1.13) 


Since , 
(1, —2,0) = 72: —4,0), 


L is traversed in the same direction as ¢ and s vary from —oo to oo in (5.1.11) and (5.1.12). 
However, since 
(=4,8, 0) = —2(2, —4, 0), 
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L is traversed in opposite directions as ¢ and t vary from —oo to oo in (5.1.11) and (5.1.13). 


Setting ¢ = 1 in (5.1.11), we see that X; = (1, —1, —1) is also on L. The line segment 
from Xo to X; consists of all points of the form 


X= 7(1,-1,-l)+d—-s#)(-1,3,-l), O<t<1. 
These familiar notions can be generalized to R”, as follows: 


Definition 5.1.10 Suppose that Xo and U are in R” and U $ 0. Then the line through 
Xo in the direction of U is the set of all points in R” of the form 


X=X9+tU, -w<t<o. 
A set of points of the form 
X=X9+tU, tt <t <b, 


is called a line segment. In particular, the line segment from Xo to X; is the set of points of 
the form 
X = Xo + ¢(Ky — Xo) = *X, + (1 —-1)X0, OK<t <1. 


Neighborhoods and Open Sets in R" 


Having defined distance in R”, we are now able to say what we mean by a neighborhood 
of a point in R”. 


Definition 5.1.11 If « > 0, the €-neighborhood of a point Xo in R" is the set 
Ne(Xo)| = {X| |X — Xo] < €}. a 


An €-neighborhood of a point Xo in R? is the inside, but not the circumference, of the 
circle of radius € about Xo. In R? it is the inside, but not the surface, of the sphere of radius 
€ about Xo. 


In Section 1.3 we stated several other definitions in terms of €-neighborhoods: neigh- 
borhood, interior point, interior of a set, open set, closed set,limit point, boundary point, 
boundary of a set, closure of a set, isolated point, exterior point, and exterior of a set. Since 
these definitions are the same for R” as for R, we will not repeat them. We advise you to 
read them again in Section 1.3, substituting R” for R and Xo for xo. 


Example 5.1.6 Let S be the set of points in R? in the square bounded by the lines 
x = +1, y = +1, except for the origin and the points on the vertical lines x = +1 
(Figure 5.1.4, page 290); thus, 


S = {(x, y)|@, ¥) 4 0,0), -l<x<l, -l<y<l}. 
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Every point of S not on the lines y = +1 is an interior point, so 
so= {(x, y) | (x,y) # (0,0), -l<x,y< 1}. 
S' is a deleted neighborhood of (0, 0) and is neither open nor closed. The closure of S is 
S={(@,y)| -1<x,y <1}, 


and every point of § is a limit point of S. The origin and the perimeter of S form 0S, the 
boundary of S. The exterior of S consists of all points (x, y) such that |x| > 1 or |y| > 1. 
The origin is an isolated point of S°. 


Cl, 1) (1, 1) 


(I, -l) (1,-1) 


Figure 5.1.4 


Example 5.1.7 If Xo is a point in R” and r is a positive number, the open n-ball of 
radius r about Xo is the set B,(Xo) = {x | |X — Xo| < i}. (Thus, €-neighborhoods are 
open n-balls.) If X1 is in S,(Xo) and 


[K —X,| <e =r—|K—Xol, 


then X is in S;(Xo). (The situation is depicted in Figure 5.1.5 forn = 2.) 

Thus, S,(Xo) contains an €-neighborhood of each of its points, and is therefore open. 
We leave it to you (Exercise 5.1.13) to show that the closure of B; (Xo) is the closed n-ball 
of radius r about Xo, defined by 
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S; (Xo) = {X|[K— Xo] <r}. 


r—|X,-X,| 


Figure 5.1.5 


Open and closed n-balls are generalizations to R” of open and closed intervals. 


The following lemma will be useful later in this section, when we consider connected 
sets. 


Lemma 5.1.12 If X, and Xz are in S;(Xo) for some r > 0, then so is every point on 
the line segment from X, to Xz. 


Proof The line segment is given by 
X=tX.+(1-t)X,, O<t< 1. 


Suppose that r > 0. If 
|X; — Xo| <7, [Xz — Xo| <7, 


and 0 <t < 1, then 


|X — Xo| = |*X2 + (1 —£)X1 —1tXo — (1 —£)Xo| 
= |t(X2 — Xo) + I —t)Xi — Xo)| 
< t|X2 — Xo| + (1 —1)|X1 — Xo| 


<tr+(1-t)r=r. q 


The proofs in Section 1.3 of Theorem 1.3.3 (the union of open sets is open, the intersec- 
tion of closed sets is closed) and Theorem 1.3.5 and its Corollary 1.3.6 (a set is closed if 
and only if it contains all its limit points) are also valid in R”. You should reread them now. 
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The Heine—Borel theorem (Theorem 1.3.7) also holds in R”, but the proof in Section 1.3 
is valid only for n = 1. To prove the Heine—Borel theorem for general n, we need some 
preliminary definitions and results that are of interest in their own right. 


Definition 5.1.13 A sequence of points {X,} in R” converges to the limit X if 
lim |X, — X| = 0. 
roo 
In this case we write _ 
lim X, = X. a 


roo 


The next two theorems follow from this, the definition of distance in R”, and what we 
already know about convergence in R. We leave the proofs to you (Exercises 5.1.16 and 
Sls?) 


Theorem 5.1.14 Let 
X= (1,%2,...,%n) and X- = (ir, X2r,..-,Xnr), rel. 


Then lim;—so0 X; = X if and only if 


that is, a sequence {X;} of points in R" converges to a limit X if and only if the sequences 
of components of {X;} converge to the respective components of X. 


Theorem 5.1.15 (Cauchy’s Convergence Criterion) A sequence {X;} in 
R” converges if and only if for each € > 0 there is an integer K such that 


[IX;-—Xs|<e if ns>K. 
The next definition generalizes the definition of the diameter of a circle or sphere. 
Definition 5.1.16 If S is a nonempty subset of R”, then 
d(S) = sup {|IX-—Y||X,YeS} 
is the diameter of S. If d(S) < co, S is bounded; if d(S) = oo, S is unbounded. 


Theorem 5.1.17 (Principle of Nested Sets) /fS,, S2,... are closed nonempty 
subsets of R" such that 


S,D$2D---DS,D--- (5.1.14) 
and 
lim d(S,) = 0, (5.1.15) 


then the intersection 


contains exactly one point. 


Section 5.1 Structure of R” 293 


Proof Let {X;} be a sequence such that X, € S; (r => 1). Because of (5.1.14), X,; € Sx 
ifr >k,so 

|X, —X;| < d(S,) if rs>k. 
From (5.1.15) and Theorem 5.1.15, X, converges to a limit X. Since X is a limit point of 
every Sx and every Sx is closed, X is in every Sx (Corollary 1.3.6). Therefore, X € I,so 
I 4. Moreover, X is the only point in /, since if Y € /, then 


IK-Y¥|<d(S,), k 21, 


and (5.1.15) implies that Y = X. au 


We can now prove the Heine—Borel theorem for R”. This theorem concerns compact 
sets. As in R, a compact set in R” is a closed and bounded set. 


Recall that a collection Jf of open sets is an open covering of a set S if 
SCU{H|He #}. 


Theorem 5.1.18 (Heine—Borel Theorem) /f # is an open covering of a com- 
pact subset S, then S can be covered by finitely many sets from #. 


Proof The proof is by contradiction. We first consider the case where n = 2, so that 
you can visualize the method. Suppose that there is a covering # for S from which it is 
impossible to select a finite subcovering. Since S is bounded, S is contained in a closed 
square 

T = {(x, y)la1 <x <a, + L,a. <x <a.+L} 


with sides of length L (Figure 5.1.6). 


TH T® 


To TO 


Figure 5.1.6 
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Bisecting the sides of T as shown by the dashed lines in Figure 5.1.6 leads to four closed 
squares, T), T?), T@), and T™, with sides of length L/2. Let 


SX =SnT®, 1K<i <4. 


Each $“ ), being the intersection of closed sets, is closed, and 


4 
v= )s”. 


i=1 


Moreover, #€ covers each S iG ). but at least one S cannot be covered by any finite sub- 
collection of J, since if all the S could be, then so could S. Let S; be a set with this 
property, chosen from S$ @) §s@) §@) and S“. We are now back to the situation we 
started from: a compact set S; covered by #, but not by any finite subcollection of #. 
However, S$; is contained in a square 7; with sides of length L/2 instead of L. Bisecting 
the sides of 7; and repeating the argument, we obtain a subset Sz of S; that has the same 
properties as S, except that it is contained in a square with sides of length L/4. Continuing 
in this way produces a sequence of nonempty closed sets So (= S), $1, Sz, ..., such that 
Sx D S41 and d(S,) < L/2*-'/? (k > 0). From Theorem 5.1.17, there is a point X in 
(ea S;. Since Xe S, there is an open set H in # that contains X, and this H must also 
contain some €-neighborhood of X. Since every X in Sx satisfies the inequality 


|X —X| < ae os 


it follows that S$; C H fork sufficiently large. This contradicts our assumption on 4, 
which led us to believe that no S; could be covered by a finite number of sets from J. 
Consequently, this assumption must be false: J€ must have a finite subcollection that covers 
S. This completes the proof for = 2. 


The idea of the proof is the same form > 2. The counterpart of the square 7 is the 
hypercube with sides of length L: 


T= {tis Xone. +4 Kn) | Gi Se SG + 1,1 1,2, yh} 


Halving the intervals of variation of the n coordinates x1, x2, ..., X, divides T into 2” 
closed hypercubes with sides of length L/2: 


PO) S41 Gea: 22igta) | Bi <x; <b; +L/2,1 <i <n}, 


where b; = a; or bj = a; + L/2. If no finite subcollection of # covers S, then at least 
one of these smaller hypercubes must contain a subset of S that is not covered by any finite 
subcollection of S'. Now the proof proceeds as for n = 2. 0 


The Bolzano—Weierstrass theorem is valid in IR”; its proof is the same as in R. 


Connected Sets and Regions 


Although it is legitimate to consider functions defined on arbitrary domains, we restricted 


Section 5.1 Structure of R” 295 


our study of functions of one variable mainly to functions defined on intervals. There are 
good reasons for this. If we wish to raise questions of continuity and differentiability at 
every point of the domain D of a function f, then every point of D must be a limit point 
of D°. Intervals have this property. Moreover, the definition of f p F(x) dx is obviously 
applicable only if f is defined on [a, b]. 


It is not productive to consider questions of continuity and differentiability of functions 
defined on the union of disjoint intervals, since many important results simply do not hold 
for such domains. For example, the intermediate value theorem (Theorem 2.2.10; see also 
Exercise 2.2.25) says that if f is continuous on an interval J and f(x1) < ww < f(x2) 
for some x; and x2 in J, then f(¥) = yw for some X in J. Theorem 2.3.12 says that f is 
constant on an interval J if f’ = 0 on J. Neither of these results holds if J is the union of 
disjoint intervals rather than a single interval; thus, if f is defined on J = (0,1) U (2,3) 
by 

1, O0<x<l, 
IO V9 gen<3, 


then f is continuous on J, but does not assume any value between 0 and 1, and f’ = 0 on 
I, but f is not constant. 


It is not difficult to see why these results fail to hold for this function: the domain of f 
consists of two disconnected pieces. It would be more sensible to regard f as two entirely 
different functions, one defined on (0, 1) and the other on (2, 3). The two results mentioned 
are valid for each of these functions. 


As we will see when we study functions defined on subsets of IR”, considerations like 
those just cited as making it natural to consider functions defined on intervals in R lead 
us to single out a preferred class of subsets as domains of functions of n variables. These 
subsets are called regions. To define this term, we first need the following definition. 


Definition 5.1.19 A subset S of R” is connected if it is impossible to represent S as 
the union of two disjoint nonempty sets such that neither contains a limit point of the other; 
that is, if S cannot be expressed as S = A U B, where 


A#®, B#M, ANB=QB, and ANB=9. (5.1.16) 


If S can be expressed in this way, then S is disconnected. 


Example 5.1.8 The empty set and singleton sets are connected, because they cannot 
be represented as the union of two disjoint nonempty sets. 


Example 5.1.9 The space R” is connected, because if R’ = AU B with AN B =@ 
and AM B = @, then A C A and B C B; that is, A and B are both closed and therefore 
are both open. Since the only nonempty subset of IR” that is both open and closed is R” 
itself (Exercise 5.1.21), one of A and B is R” and the other is empty. 
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y 


Figure 5.1.7 


If X,, Xo,..., Xx are points in R” and L; is the line segment from X; to Xj41, 1 <i < 
k — 1, we say that Ly, L2,..., Lx_, form a polygonal path from X, to Xx, and that X; 
and X, are connected by the polygonal path. For example, Figure 5.1.7 shows a polygonal 
path in R? connecting (0,0) to (3,3). A set S is polygonally connected if every pair of 
points in S can be connected by a polygonal path lying entirely in S. 


Theorem 5.1.20 An open set S in R" is connected if and only if it is polygonally 
connected. 


Proof For sufficiency, we will show that if S is disconnected, then S is not polygonally 
connected. Let S = A U B, where A and B satisfy (5.1.16). Suppose that X; € A and 
X2 € B, and assume that there is a polygonal path in S connecting Xj to X2. Then some 
line segment L in this path must contain a point Y; in A and a point Y2 in B. The line 
segment 

X=tY.+(1-t)¥Y;, O<t <1, 


is part of L and therefore in S. Now define 
p =sup{t|tY2+(1—4)¥1 €A,0<t<t< He 


and let 
Xp = pY2 +(1—p)Y1. 


Then X, € ANB. However, since X, € AUB and ANB = ANB = Y, this is impossible. 
Therefore, the assumption that there is a polygonal path in S from Xj to Xz must be false. 
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For necessity, suppose that S is a connected open set and Xo € S. Let A be the set 
consisting of Xo and the points in S can be connected to Xo by polygonal paths in S. Let 
B be set of points in S that cannot be connected to Xo by polygonal paths. If Yo € S, then 
S contains an €-neighborhood Ne(Yo) of Yo, since S is open. Any point Y; in Ne(Yo can 
be connected to Yo by the line segment 


X=1¥;+(1-0Yo, 0<t <1, 


which lies in Ne(Yo) (Lemma 5.1.12) and therefore in S. This implies that Yo can be 
connected to Xo by a polygonal path in S if and only if every member of NV, (Yo) can also. 
Thus, N-(Yo) C Aif Yo € A, and N.(Yo) € Bif Yo € B. Therefore, A and B are open. 
Since AN B = Q, this implies that AN B = AN B = @ (Exercise 5.1.14). Since A is 
nonempty (Xo € A), it now follows that B = Q, since if B # 9, S would be disconnected 
(Definition 5.1.19). Therefore, A = S, which completes the proof of necessity. 0 


We did not use the assumption that S is open in the proof of sufficiency. In fact, we actu- 
ally proved that any polygonally connected set, open or not, is connected. The converse is 
false. A set (not open) may be connected but not polygonally connected (Exercise 5.1.29). 


Our study of functions on R” will deal mostly with functions whose domains are regions, 
defined next. 


Definition 5.1.21 A region S in R” is the union of an open connected set with some, 
all, or none of its boundary; thus, 5° is connected, and every point of S is a limit point of 
ie 


Example 5.1.10 Intervals are the only regions in R (Exercise 5.1.31). The n-ball 
B,(Xo) (Example 5.1.7) is a region in R”, as is its closure S;(Xo). The set 
S={(@,y)|x?7+y7 <1 or x? + y* > 4} 


(Figure 5.1.8(a), page 298) is not a region in R?, since it is not connected. The set Sj 
obtained by adding the line segment 


iy: X=1(0,2)+d-s)0,1), O<t<1, 


to S (Figure 5.1.8(b)) is connected but is not a region, since points on the line segment are 
not limit points of S?. The set Sz obtained by adding to S; the points in the first quadrant 
bounded by the circles x? + y? = 1 and x? + y” = 4 and the line segments L,; and 


Lz: X =t(2,0)+Ud-2)0,0), O<t<1l 
(Figure 5.1.8(c)), is a region. 
More about Sequences in R® 


From Definition 5.1.13, a sequence {X;,} of points in R” converges to a limit X if and only 
if for every € > 0 there is an integer K such that 


IXe=Xl<e if r> kK. 
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The R” definitions of divergence, boundedness, subsequence, and sums, differences, and 
constant multiples of sequences are analogous to those given in Sections 4.1 and 4.2 for 
the case where n = 1. Since R” is not ordered for n > 1, monotonicity, limits inferior and 
superior of sequences in R”, and divergence to too are undefined for n > 1. Products and 
quotients of members of R” are also undefined ifn > 1. 


>< 
—_>< 


(c) 


Figure 5.1.8 


Several theorems from Sections 4.1 and 4.2 remain valid for sequences in R”, with proofs 
unchanged, provided that “| |" is interpreted as distance in R”. (A trivial change is re- 
quired: the subscript n, used in Sections 4.1 and 4.2 to identify the terms of the sequence, 
must be replaced, since n here stands for the dimension of the space.) These include The- 
orems 4.1.2 (uniqueness of the limit), 4.1.4 (boundedness of a convergent sequence), parts 
of 4.1.8 (concerning limits of sums, differences, and constant multiples of convergent se- 
quences), and 4.2.2 (every subsequence of a convergent sequence converges to the limit of 
the sequence). 
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5.1 Exercises 


With R replaced by R", the following exercises from Section 1.3 are also suitable for this 
section: 1.3.7-1.3.10, 1.3.12-1.3.15, 1.3.19, 1.3.20 (except (e)), and 1.3.21. 


1. FindaX+ by. 
(a) X=(1,2,-3,1), Y=(0,-1,2,0),a =3,b =6 
(b) X=(1,-1,2), Y=(0,-1,3),4=—-1,b=2 
(c) X=(.3.g5)) Y= (-7.1,5,9),4= 7,0 =§ 
2. Prove Theorem 5.1.2. 


3. Find |X|. 

(a) (1, 2, —3, 1) (b) (4, Ps +¢ 

(c) (1,2,—1,3, 4) (d) (0, 1,0, —1, 0, —1) 
4. Find |X—Y]. 

(a) X=(,4,5,-4),, Y=(2,0,-1,2) 

(b) X=(3,5,9-a)) Y=(9,-§.5)-3) 


(c) X=(0,0,0), Y= (2,-1,2) 
(d) X=(,-1,4,0,-1), Y =(2,0,1,-4,1) 


5. Find X-Y. 
(a) X= (3,4,5,-4), Y= (,0,3,3) 
(b) X=(%. 75-39): YeChdd a) 
(c) X=(1,2,-3,1,4), Y= (1,2,-1,3,4) 


6. Prove Theorem 5.1.9. 
7. Find a parametric equation of the line through Xo in the direction of U. 
(a) Xo = (1,2,-3,1), U=(3,4,5,—4) 
(b) Xo = (2,0, ee 4) U=(- 1014 2) 
(c) Xo = (-}, 3 2 re —4), U=G,- a = _ 
8. Suppose that U 4 0 and V ¥ 0. Complete the sentence: The equations 
X=X,9+tU, -w<t<wo, 
and 
X=X,+5V, -w<K<s<am, 
represent the same line in R” if and only if ... 
9. Find the equation of the line segment from Xo to X1. 
(a) Xo = (1,—-3,4,2), Xi = (2,0,-1,5) 
(b) Xo = (3,1-—2,1,4), Xi = (2,0,-1,4, -3) 
(c) Xo =(1,2,-1), X1 = (0,-1,-1) 
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10. Find sup {e | Ne(Xo) C S}. 
(a) Xo = (1,2,—1,3); S = the open 4-ball of radius 7 about (0, 3, —2, 2) 
(b) Xo = (1,2,-1,3); S = {(x1, x2, x3, x4) | als 5,1ls7 <4} 
(c) Xo = (3, 3); S = the closed triangle with vertices (2,0), (2,2), and (4, 4) 
11. Find (i) 0S; (ii) S; (iii) S°; (iv) exterior of S. 
(a) 8 = {is xe, x3, 4a) | [ei < 3,7 = 1, 2,3} 
(b) S={@,y,D|x?+y?<}} 
12. Describe the following sets as open, closed, or neither. 
(a) S= {(x1, X2,.X3, x4) | |x1| > 0, x2 < 1,x3F —2\ 
(b) S = {(x1, x2, x3, x4) | 1 = 1,x3 # —4} 
(c) S = {(x1, x2,x3, x4) [x1 = 1,-3 S x2 S 1,x4 = —5} 


13. Show that the closure of the open n-ball 
B,(Xo) = {X||K —Xo| <r} 


is the closed n-ball 
B,(Xo) = {X||X—Xo] <r}. 

14. Prove: If A and B are open and AN B = @, then AN B=ANB=Z. 
15. Show that if lim,;_,.) X; exists, then it is unique. 
16. Prove Theorem 5.1.14. 
17. Prove Theorem 5.1.15. 
18. Find lim;—oo Xr. 

(a) X-= (r sin as cos x e) 

r r 


Vs #1 1\' 
b) X,=(1-—1 Al+= 
() ( 2 ea (its) ) 
19. Find d(S). 


(a) S = {(x, y,x)||x] <2,|y| < 1,Jz-2| <2} 


_ 4)2 _4)2 
(b) 5 =}.y|S5 + OS at 


(c) S$ = the triangle in R? with vertices (2,0), (2,2), and (4, 4) 
(d) 5 = {te te) | SPH 1,2} 
(e) S={@,y¥,z)|x 49, |yl < 1.2 > 2} 
20. Prove that d(S) = d(S) for any set S in R”. 
21. Prove: If a nonempty subset S of R” is both open and closed, then S = R”. 


22. 


23. 


24. 


25. 


26. 
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Use the Bolzano—Weierstrass theorem to show that if S;, So, ..., Sm, ... iS an 
infinite sequence of nonempty compact sets and S$; D Sz D--: D Sm D-:-, then 
(\p=1 Sm is nonempty. Show that the conclusion does not follow if the sets are 
assumed to be closed rather than compact. 


Suppose that a sequence U;, U2, ... of open sets covers a compact set S. Without 
using the Heine—Borel theorem, show that S C ea Um for some N. HINT: 
Apply Exercise 5.1.22 to the sets Sy = SM (C= Um) ; 


(This is a seemingly restricted version of the Heine—Borel theorem, valid for the 
case where the covering collection # is denumerable. However, it can be shown 
that there is no loss of generality in assuming this.) 


The distance from a point Xo to a nonempty set S is defined by 
dist(Xo, S) = inf {[K — Xo||X € S}. 
(a) Prove: If S is closed and Xo € R", there is a point X in S such that 
|X — Xo| = dist(Xo, S). 
HINT: Apply Exercise 5.1.22 to the sets 
Cm = {X|X € S and |X — Xo| < dist(Xo,S)+1/m}, m>1. 


(b) Show that if S is closed and Xo ¢ S, then dist(Xo, S) > 0. 
(c) Show that the conclusions of (a) and (b) may fail to hold if S is not closed. 


The distance between two nonempty sets S and T is defined by 
dist(S, 7) = inf {[IX—Y||KeS,YeT}. 


(a) Prove: If S is closed and T is compact, there are points X in S and Y in T 
such that a 
|X — Y| = dist(S, T). 
HINT: Use Exercises 5.1.22 and 5.1.24. 
(b) Under the assumptions of (a), show that dist(S, 7) > 0if Sn T =9. 
(c) Show that the conclusions of (a) and (b) may fail to hold if S or T is not 
closed or T is unbounded. 


(a) Prove: If a compact set S is contained in an open set U, there is a positive 
number r such that the set 


S; = {X| dist(X, S) <r} 


is contained in U. (You will need Exercise 5.1.24 here.) 
(b) Show that S, is compact. 
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27. Let D; and D2 be compact subsets of R”. Show that 
D = {(X%,Y)|X € D),Y¥ € D>} 


is a compact subset of R?”. 


28. Prove: If § is open and §S = AU B where AN B = AN B =Q, then A and B are 
open. 


29. Give an example of a connected set in R” that is not polygonally connected. 
30. Prove that a region is connected. 
31. Show that the intervals are the only regions in R. 


32. Prove: A bounded sequence in R” has a convergent subsequence. HINT: Use Theo- 
rems 5.1.14, 4.2.2, and 4.2.5(a). 


33. Define “lim;—.9) X; = oo” if {X;} is a sequence in R”,n > 2. 


5.2 CONTINUOUS REAL-VALUED FUNCTIONS OF n VARI- 
ABLES 


We now study real-valued functions of n variables. We denote the domain of a function f 
by Df and the value of f at a point X = (x1, X2,...,Xn) by f(X) or f(x1, X2,..., Xn). 
We continue the convention adopted in Section 2.1 for functions of one variable: If a func- 
tion is defined by a formula such as 


f(X) = (1—-x2 — x2 -...— x2)! (5.2.1) 
or 

g%) = (lox? = ee) (5.2.2) 
without specification of its domain, it is to be understood that its domain is the largest 
subset of IR” for which the formula defines a unique real number. Thus, in the absence of 


any other stipulation, the domain of f in (5.2.1) is the closed n-ball {X | |X| < 1}, while 
the domain of g in (5.2.2) is the set {x | |X| A I}. 


The main objective of this section is to study limits and continuity of functions of n 
variables. The proofs of many of the theorems here are similar to the proofs of their coun- 
terparts in Sections 2.1 and . We leave most of them to you. 


Definition 5.2.1 We say that f(X) approaches the limit L as X approaches Xo and 
write 
li X)=L 
XX FC ) 
if Xo is a limit point of D ¢ and, for every € > 0, there is a 5 > 0 such that 
|f(X) —L| <e 


for all X in D ¢ such that 
0 < |X — Xo| <6. 
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Example 5.2.1 If 
a(x, y) =1 — x? —2y?, 
then 
lim g(x,y) =1—x2 —2y2 (5.2.3) 
(x,y)>(x0.¥0) 


for every (Xo, Yo). To see this, we write 
lg(x, y) — (1 — x§ — 2yG)| = |(1 — x? — 2y?) — (1 — xG — 299)! 
< |x? — x6] + 2ly? — y6| 
= |(x + xo)(x — X0)| + 2|(y + yo)(y — yo)| 
< |X — Xo|([x + xo] + 2|y + yo)l), 


(5.2.4) 


since 
|x —xo| <|X—Xo| and |y —yo| < |K—Xol. 


If |X — Xo| < 1, then |x| < |x| + 1 and |y| < |yo| + 1. This and (5.2.4) imply that 
|g. y) — (l= x9 = 2y6)| < KIK—Xo| if |X—Xol| <1. 
where 
K = (2|xo| + 1) + 2(2|yo| + D. 


Therefore, if ¢ > 0 and 
|X — Xo| < 6 = min{1,€/K}, 


then 
|g(x, y) — (1 — xg —2y9)| <. 
This proves (5.2.3). | 


Definition 5.2.1 does not require that f be defined at Xo, or even on a deleted neighbor- 
hood of Xo. 


Example 5.2.2 The function 


sin 1 — x? —2y? 
Vl—x?—2y? 


is defined only on the interior of the region bounded by the ellipse 


h(x, y) = 


x? 42y? =1 


(Figure 5.2.1(a), page 304). It is not defined at any point of the ellipse itself or on any 
deleted neighborhood of such a point. Nevertheless, 


lim A(x, y)=1 (5.2.5) 


(x,y)>(x0,¥o) 
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if 
xg + 2y6 = 1. (5.2.6) 


u(x, y) = ~l—x? —-2y?. 


To see this, let 


Then ; 
eae eegaacie ed (5.2.7) 
u(x, y) 
Recall that : 
_ sinr 
lim — =1; 
r>0 1 
therefore, if € > 0, there is a 5, > O such that 
sin u . 
—-l)<e if 0<|ul<36;. (5.2.8) 
u 


From (5.2.3), 


lim 1—x?—2y*) =0 
aie niaae 7 ) 


if (5.2.6) holds, so there is a 5 > O such that 

0 < u(x, y) = (1—x? -—2y) < 57 
if X = (x, y) is in the interior of the ellipse and |K — Xo| < 6; that is, if X is in the shaded 
region of Figure 5.2.1(b). 


Therefore, 
O0<u= V1—x?2-2y? < §; (5.2.9) 


if X is in the interior of the ellipse and |K — Xo| < 4; that is, if X is in the shaded region of 
Figure 5.2.1(b). This, (5.2.7), and (5.2.8) imply that 


lA, y)- 1] <e 
for such X, which implies (5.2.5). 
¥ Ry 
A A 
,  ~ IX-X,1= 8 
7 N 
/ \ 
—_ EEE > * > xX 
\ / 
= sw 
x+2y?=1 x?+2y?=1 


(a) (b) 
Figure 5.2.1 
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The following theorem is analogous to Theorem 2.1.3. We leave its proof to you (Exer- 
cise 5.2.2). 


Theorem 5.2.2 Iflimy—x, f(X) exists, then it is unique. 


When investigating whether a function has a limit at a point Xo, no restriction can be 
made on the way in which X approaches Xo, except that X must be in Dy. The next 
example shows that incorrect restrictions can lead to incorrect conclusions. 


Example 5.2.3 The function 


xy 

x,y) = = 
ION= 5 +7 
is defined everywhere in R* except at (0,0). Does lim(.,y)-+(0,0) f(x, y) exist? If we try 
to answer this question by letting (x, y) approach (0, 0) along the line y = x, we see the 


functional values 
1 


x 
IE = Fa = 5 


and conclude that the limit is 1/2. However, if we let (x, y) approach (0, 0) along the line 
y = —x, we see the functional values 


a 1 
x,-x)=-—> =-Hx 
I == 5 
and conclude that the limit equals —1/2. From Theorem 5.2.2, these two conclusions 
cannot both be correct. In fact, they are both incorrect. What we have shown is that 


: 1 : 1 
tim f(x, x) = 5 and jim f(x, -x) = —5 
Since limy+9 f(x, x) and lim,+9 f(x, —x) must both equal limx,y)+0,0) f(x, y) if the 
latter exists (Exercise 5.2.3(a)), we conclude that the latter does not exist. a 


The sum, difference, and product of functions of 1 variables are defined in the same 
way as they are for functions of one variable (Definition 2.1.1), and the proof of the next 
theorem is the same as the proof of Theorem 2.1.4. 


Theorem 5.2.3 Suppose that f and g are defined on a set D, Xo is a limit point of 
D, and 


li X)y=L;, li X) = L>. 
gun. 1 lim 8% 2 


Then 

lim (f + g)(X) = 11 + Lo, (5.2.10) 

X—Xo 
lim (f — g)(K) = Li -L2, 62:11) 

xX—>Xo 
lim (fg)(X) = Lilz, (5.2.12) 

X—Xo 
and, if Lz # 0, 


' 2 _ ti 
im (4) ) =F. (5.2.13) 
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Infinite Limits and Limits as |X|—co 


Definition 5.2.4 We say that f(X) approaches oo as X approaches Xo and write 


ee F(X) tes 


if Xo is a limit point of D ¢ and, for every real number M, there is a 6 > 0 such that 
f(&) >M_ whenever 0<|X—Xo|<6 and Xe Dy. 
We say that 
lim f(X) = —oo 


xX—Xo 


im (AK) = 0. 


Example 5.2.4 If 
PRS as Se Soe 
then 
eu F(X) = 00 


if |Xo| = 1, because 
1 


f(®) = ]X—Xol’ 


SO 
1 
f(X)>M if 0<|X-Xo| <3 =—7. 


Example 5.2.5 If 
1 
NOS eB eT 
then lim¢x,y)+(1,-1) f(x, y) does not exist (why not?), but 


lim xX, =o. 
exe f(x, »)| 


To see this, we observe that 
Ix +2y+ 1, =|(x -—1)+20 4+1)| 
< J5|X —Xo| (by Schwarz’s inequality), 
where Xo = (1, —1), so 


1 


1 
x, y)| = ————— > ———_.. 
Gy) Ix + 2y +1] ~ /5|K — Xo| 
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Therefore, 
[f(x,y] >M if 0<|X—Xo| < 


1 
MJ 


. 1 
Sh. == 
(x oe Stan 2) 


x2 + y? + 7? 


Example 5.2.6 The function 


SX. D= 


assumes arbitrarily large values in every neighborhood of (0,0, 0). For example, if X,; = 
(Xk, Vk» Zk), Where 
1 
3 (k + +) si 
then 


f(X®x) = (i ae 5) I. 


However, this does not imply that limx_,9 f(X) = ov, since, for example, every neighbor- 
hood of (0, 0, 0) also contains points 


a2 1 1 1 
x = eS 
‘ (= V3kn a) 
for which f(X;) = 0. 


Definition 5.2.5 If D¢ is unbounded, we say that 


lim f(X)=L (finite) 


|X|>00 
if for every € > 0, there is anumber R such that 


|f(X)-—L|<e whenever |X|>R and XeD,. 


Example 5.2.7 If 


1 
fton2) =o ara): 


then 
lim f(X) =1. (5.2.14) 
|X|>00 
To see this, we recall that the continuity of cos u at u = 0 implies that for each € > 0 there 
isa dé > 0 such that 
|cosu—I1|<e if |u| <6. 
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Since 
1 1 


it follows that if |X| > 1//8, then 
1 
Pryp+e <! 
Therefore, 
| f(X) —1| <e. 
This proves (5.2.14). 


Example 5.2.8 Consider the function defined only on the domain 
D = {(@, y)|0< y < ax}, 0<a<l 


(Figure 5.2.2), by 
1 
f(x,y) = —. 
x—y 


We will show that 
lim f(x,y) =0. (5.2.15) 


|X|—o00 
It is important to keep in mind that we need only consider (x, y) in D, since f is not 
defined elsewhere. 


In D, 
x-y>x(l-a) (5.2.16) 
and 
|X|? = x2 a 7" < x*(1 i a’), 
so 
[X| 
~ /1 + a2 
This and (5.2.16) imply that 
> 1=4 x), xep 
A=) 2 ; ; 
V1 +a? 
so 
v1 2 1 
If@ yw < fs, ED 
l-a |X| 
Therefore, 
If@, y)| <€ 
if X € D and 
V1+a?1 
|x| > ————-. 
l-a e 


This implies (5.2.15). 
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Figure 5.2.2 


We leave it to you to define limjx|o0 f(X) = 00 and limjx|.o. f(X) = —oo (Exer- 
cise 5.2.6). 

We will continue the convention adopted in Section 2.1: “limy_.x, f(X) exists” means 
that limyx_,x, f(X) = L, where L is finite; to leave open the possibility that L = too, we 
will say that “limx_.x, /(X) exists in the extended reals.” A similar convention applies to 
limits as |X| — oo. 

Theorem 5.2.3 remains valid if “limxy.x,)” is replaced by “lim)x|+o0,” provided that 
D is unbounded. Moreover, (5.2.10), (5.2.11), and (5.2.12) are valid in either version of 
Theorem 5.2.3 if either or both of L; and Lz is infinite, provided that their right sides are 
not indeterminate, and (5.2.13) remains valid if Lz 4 0 and L/L is not indeterminate. 


Continuity 


We now define continuity for functions of n variables. The definition is quite similar to the 
definition for functions of one variable. 


Definition 5.2.6 If Xo is in Dy and is a limit point of Dy, then we say that f is 
continuous at Xo if 


gn f(X) = f (Xo). a 


The next theorem follows from this and Definition 5.2.1. 


310 Chapter 5 Real- Valued Functions of Several Variables 


Theorem 5.2.7 Suppose that Xo is in Dy and is a limit point of D ¢. Then f is con- 
tinuous at Xo if and only if for each € > 0 there is a6 > 0 such that 


If(X) — f(Xo)| <€ 


whenever 
[X—Xo|<65 and Xe Df. 


In applying this theorem when Xp € D®, we will usually omit “and X € D f> it being 
understood that Ss(Xo) C Dy. 


We will say that f is continuous on S if f is continuous at every point of S. 
Example 5.2.9 From Example 5.2.1, we now see that the function 


f(x,y) =1-—x? —2y? 


is continuous on R?. 


Example 5.2.10 If we extend the definition of / in Example 5.2.2 so that 


sin 1 — x? —2y? 
A(x, y) = /[ — x2 — Dy? , 


1, x? 4+2y? =1, 


x? 4+ 2y? <1, 


then it follows from Example 5.2.2 that / is continuous on the ellipse 
x? +2y? =1. 
We will see in Example 5.2.13 that h is also continuous on the interior of the ellipse. 


Example 5.2.11 It is impossible to define the function 


Se 
(y= x2 4 y? 


at the origin to make it continuous there, since we saw in Example 5.2.3 that 


lim Xx: 
(x,y)>(0,0) fey) 


does not exist. 
Theorem 5.2.3 implies the next theorem, which is analogous to Theorem 2.2.5 and, like 


the latter, permits us to investigate continuity of a given function by regarding the function 
as the result of addition, subtraction, multiplication, and division of simpler functions. 
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Theorem 5.2.8 /f f and g are continuous ona set S inR", then so are f +g, f —g, 
and fg. Also, f/g is continuous at each Xo in S such that g(Xo) # 0. 


Vector- Valued Functions and Composite Functions 


Suppose that g1, g2,..., Zn are real-valued functions defined on a subset T of R”, and 
define the vector-valued function G on T by 


G(U) = (g1(U), g2(U),...,8n(U)), Ue. 
Then 21, 22,..-, Zn are the component functions of G = (g1, g2,..., Zn). We say that 
li =L=(Li,L2,...,L 
ma G(U) (Li, Lo n) 


if 
lim g;(U)=L;, 1<i<n, 
UU gil ) i SUS 
and that G is continuous at Up if g1, g2, ..., Zn are each continuous at Ug. 


The next theorem follows from Theorem 5.1.14 and Definitions 5.2.1 and 5.2.6. We omit 
the proof. 


Theorem 5.2.9 For a vector-valued function G, 
li =L 
Uo om) 
if and only if for each € > 0 there isa dé > 0 such that 
|IG(U) —L| <¢€ whenever 0<|U—Up|<6 and Ue Deg. 


Similarly, G is continuous at Uo if and only if for each € > 0 there is a6 > 0 such that 


|G(U) — G(Up)| < € =whenever |U—Uo| <6 and Ue Dg. 


The following theorem on the continuity of a composite function is analogous to Theo- 
rem 2.2.7. 


Theorem 5.2.10 Let f be a real-valued function defined on a subset of R", and let 
the vector-valued function G = (g1, g2,..-,n) be defined on a domain Dg in R”. Let 
the set 

T={U|UeDg and G(U)E Dy} 


(Figure 5.2.3), be nonempty, and define the real-valued composite function 
h=foG 


onT by 
h(U) = f(G)), Ue T. 


Now suppose that Up is in T and is a limit point of T, G is continuous at Uo, and f is 
continuous at Xo = G(U9). Then h is continuous at Uo. 
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R(G) = range of G 


I 

| 
R" : | R" 

- a 

| 
| 
| 
| 
| 
| 
| 


Dg 


Figure 5.2.3 


Proof Suppose that « > 0. Since f is continuous at Xo = G(Up), there is an ¢; > 0 
such that 


If(X) — f(G(Up))| < € (5.2.17) 
if 
[X—G(Up)|<€1 and Xe Dy. (5.2.18) 
Since G is continuous at Up, there is ad > O such that 
|G) — G(Up)| <e. if JU—Uo| <6 and Ue Dg. 
By taking X = G(U) in (5.2.17) and (5.2.18), we see that 


|n(U) — h(Uo)| = |f(GU) — f(GUo))| < € 


[U—Up| <6 and UeT. 


Example 5.2.12 If 
{ua vs 
and 
g(x,y) = 1—x? —2y’, 
then D ¢ = [0, 00], De = R’, and 
T= {(x, y) |x? + 2y? < Ip. 


From Theorem 5.2.7 and Example 5.2.1, g is continuous on R?. (We can obtain the same 
conclusion by observing that the functions pi(x, y) = x and po(x, y) = y are continuous 
on R? and applying Theorem 5.2.8.) Since f is continuous on D f» the function 


h(x, y) = f (g(x, y)) = V1 —x? —2y? 


is continuous on T. 
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Example 5.2.13 If 


g(x,y) = V1 —x?—2y? 


sins 

—, s#0, 
f(s)=4 8 * 

1, s=0, 


and 


then D ¢ = (—oo, 00) and 
Dg =T = {(x, y) |x? +2y <1}. 


In Example 5.2.12 we saw that g (we called it there) is continuous on T. Since f is 
continuous on D , the composite function h = f o g defined by 


sin 1 — x? — 2y2 
h(x, y) = /| — x2 — Dy? , 


1, x?+4+2y? =1, 


x? 4+2y? <1, 


is continuous on 7’. This implies the result of Example 5.2.2. 


Bounded Functions 


The definitions of bounded above, bounded below, and bounded on a set S are the same for 
functions of 1 variables as for functions of one variable, as are the definitions of supremum 
and infimum of a function on a set S' (Section 2.2). The proofs of the next two theorems are 
similar to those of Theorems 2.2.8 and 2.2.9 (Exercises 5.2.12 and 5.2.13). 


Theorem 5.2.11 If f is continuous on a compact set S in R", then f is bounded 
on S. 


Theorem 5.2.12 Let f be continuous on a compact set S in R" and 
a = inf f(X), 6 = sup f(X). 
xeS Xes 


Then 
f(%1) =a and f(®%.)=6 
for some X, and Xz in S. 


The next theorem is analogous to Theorem 2.2.10. 


Theorem 5.2.13 (Intermediate Value Theorem) Let f be continuous on 
a region S in R". Suppose that A and B are in S and 


F(A) <u < f(B). 
Then f (C) = u for some C in S. 


314 Chapter 5 Real- Valued Functions of Several Variables 


Proof [If there is no such C, then S = RU T, where 


R= {X|X eS and f(X) < u} 
and 
T = {X|X eS and f(X) > u}. 


If Xo € R, the continuity of f implies that there is ad > O such that f(X) < wif |K—Xo| < 
6 and X € S. This means that Xp ¢ T. Therefore, RN T = Q. Similarly, RN T = @. 
Therefore, S is disconnected (Definition 5.1.19), which contradicts the assumption that S 
is a region (Exercise 5.1.30). Hence, we conclude that f(C) = u for some C in S. 0 


Uniform Continuity 


The definition of uniform continuity for functions of 1 variables is the same as for functions 
of one variable; f is uniformly continuous on a subset S of its domain in R” if for every 
€ > Othere is ad > 0 such that 


If(X) — f&)| <e 


whenever |X — X’| < 6 and X, X’ € S. We emphasize again that 5 must depend only on € 
and S, and not on the particular points X and X’. 


The proof of the next theorem is analogous to that of Theorem 2.2.12. We leave it to you 
(Exercise 5.2.14). 


Theorem 5.2.14 If f is continuous on a compact set S in R", then f is uniformly 
continuous on S. 


5.2 Exercises 


With R replaced by R" , the following exercises from Sections 2.1 and 2.2 have analogs for 
this: section: 21,5, 21.82.0411, 2.126, 2.1.28, 2.1.29) 2.1.33, 2.2:8.22.9) 22.10: 2.2.15, 
PANG 220 eo ea: 


1. Find limx-,x, /(X) and justify your answer with an e—d argument, as required by 
Definition 5.2.1. HINT: See Examples 5.2.1 and 5.2.2. 


(a) f%) =3x+4y+z-2, Xo =(1,2,1) 


93.3 

(b) fX) =>, x =0,1) 
x—y 
sin(x + 4y + 2z) 


te) 700 x +4y +2z 


» Xo = (-2,1,-1) 
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(d) f(X) = (x? + y?)log(x? + y?)/?, Xo = 0,0) 
sin(x — y) 
Vx —y 


(f) f(%)= mel" Xo =0 


Prove Theorem 5.2.2. 


If limy+x 9 v(x) = yo and limy+x. f (x, y(x)) = L, we say that f(x, y) ap- 
proaches L as (x, y) approaches (xo, yo) along the curve y = y(x). 


(e) f®M= » Xo = (2,2) 


(a) Prove: If limg,y)+(xo.v9) f(x, y) = L, then f(x, y) approaches L as (x, y) 
approaches (xo, yo) along any curve y = y(x) through (x9, yo). 
(b) We saw in Example 5.2.3 that if 


fy) = re 
then limy,,y)-+(0,0) f(*, y) does not exist. Show, however, that f(x, y) ap- 
proaches a value Ly as (x, y) approaches (0,0) along any curve y = y(x) 
that passes through (0, 0) with slope a. Find Lg. 


(c) Show that the function 


( y= tae i 
OS OF + VP 


approaches 0 as (x, y) approaches (0, 0) along a curve as described in (b), 
but that lim,,y)-+(0,0) f(*, y) does not exist. 


Determine whether limx_,x, {(X) = oo. 
| sin(x + 2y + 4z)| 


(a) 0) = Spr Xo = 2-10) 
1 
b X) = , Xo = (0,0 
(b) FO) = a X0= (0.0) 
sin 1/x 

xX ‘ 0,0 

(c) f= A (0, 0) 
=i 
(d) f(x = (2,1) 
_ sin + 2y + 4z) = 

(e) f&® = Crop pee: = (2,—1,0) 
Find lim)x|o9 f(X), if it exists. 
(a) #(X) = log(x? + 2y? + 427) (b) f(x) = sin(x? + y?) 


x2 + y? + 2? 


Vx? + y? 
(c) f(X) = ee” (d) f(X) =e” 
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sin(x? — y?) 
(e) f(X) = x2—y2 ” OE 
1, xo ey 
Define (a) limyxj+o0 f(X) = 00 and (b) limjxj4o0 f(X) = —00. 


Let 
[x1 [41 |x2|9? «+ |xn |?" 


F(X) = 


x|? 
For what nonnegative values of a1, d2, ..., Gn, b does limx-,9 f(X) exist in the 
extended reals? 
Ee 2 4)3 
(x* + y") 
g(X) = te hye 
+ x°y 


Show that lim),|-,59 g(x, ax) = oo for any real number a. Does 


lim g(X) = w? 


|X|—00 


For each f in Exercise 5.2.1, find the largest set S on which f is continuous or can 
be defined so as to be continuous. 


Repeat Exercise 5.2.9 for the functions in Exercise 5.2.5. 


Give an example of a function f on R? such that f is not continuous at (0, 0), 
but f(0, y) is a continuous function of y on (—oo, 00) and f(x, 0) is a continuous 
function of x on (—oo, 00). 


Prove Theorem 5.2.11. HINT: See the proof of Theorem 2.2.8. 
Prove Theorem 5.2.12. HINT: See the proof of Theorem 2.2.9. 
Prove Theorem 5.2.14. HINT: See the proof of Theorem 2.2.12. 


Suppose that X ¢ D f¢ CR" and X is a limit point of D yf» Show that f is continuous 
at X if and only if limg_.oo f (Xi) = f (X) whenever {X;} is a sequence of points 
in D ¢ such that limg_,,. X, = X. HINT: See the proof of Theorem 4.2.6. 


5.3 PARTIAL DERIVATIVES AND THE DIFFERENTIAL 


To say that a function of one variable has a derivative at xo is the same as to say that it 
is differentiable at x9. The situation is not so simple for a function f of more than one 
variable. First, there is no specific number that can be called the derivative of f at a point 
Xo in R”. In fact, there are infinitely many numbers, called the directional derivatives of 
ff at Xo (defined below), that are analogous to the derivative of a function of one variable. 
Second, we will see that the existence of directional derivatives at Xo does not imply that f 
is differentiable at Xo, if differentiability at Xo is to imply (as it does for functions of one 
variable) that f(X)— f(Xo) can be approximated well near Xo by a simple linear function, 
or even that f is continuous at Xo. 
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We will now define directional derivatives and partial derivatives of functions of several 
variables. However, we will still have occasion to refer to derivatives of functions of one 
variable. We will call them ordinary derivatives when we wish to distinguish between them 
and the partial derivatives that we are about to define. 


Definition 5.3.1 Let ® be a unit vector and X a point in R”. The directional derivative 
of f at X in the direction of ® is defined by 


Uf(X) 5 f(K +1) — fO%) 
a® ~~ 0 t 


if the limit exists. That is, 0f (X)/0® is the ordinary derivative of the function 
h(t) = f®%+t®) 

at t = 0, if h’(0) exists. 

Example 5.3.1 Let ® = (91, ¢2, 63) and 


Cee ere 


Then 
h(t) = f(x + thi, y + tb2,z + tO), 
= 3(x + thi)(y + tho)(z + ths) + 2(x + thi)? + (z + 163)? 
and 
h'(t) = 3b1(y + tha)(z + th3) + 3h2(x + thi)(z + ths) 
+ 3h3(x + th1)(y + th2) + 4hi(x + th1) + 263(z + ts). 
Therefore, 
ve =h'(0) = Byz + 4x)b1 + 3xzdb2 + Bxy + 2z)43. (5.3.1) 
|_| 


The directional derivatives that we are most interested in are those in the directions of 
the unit vectors 


E; =(1,0,...,0), E2=(0,1,0,...,0),...,. Ex =(0,...,0, 1). 


(All components of E; are zero except for the ith, which is 1.) Since X and X + rE; differ 
only in the ith coordinate, 0f (X)/0E; is called the partial derivative of f with respect to 
x; at X. It is also denoted by df (X)/dx; or f,; (X); thus, 


df (X) 


0X4 = 


— fr +t, x2,...,Xn) — f(X1, X2,.--, Xn) 
fay %) = Lim AR Pn 
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ue = f,(%) = Ii jm Lob Sn Pts) SP Nae) 
oo <n, and 
re) = fy, (X) = fr acai eS 


if the ace exist. 


If we write X = (x, y), then we denote the partial derivatives accordingly; thus, 


af (x,y) I@ +h, y) — fG@;Y) 


ie — = fx(x, y) = a hi 
and 
Of (x, ’ yth)—fG, 
a = f(x,y) = fim SO, y + , FY) 


It can be seen from these definitions that to compute f,,(X) we simply differentiate f 
with respect to x; according to the rules for ordinary differentiation, while treating the other 
variables as constants. 


Example 5.3.2 Let 
f(%, y, Z) = 3xyz + 2x? + 2? (5.3.2) 
as in Example 5.3.1. Taking ® = Ej (that is, setting ¢; = 1 and ¢@2 = ¢3 = 0) in (5.3.1), 


we find that 
af(X) _ af®) _ 


Ox 2) On 
which is the result obtained by regarding y and z as constants in (5.3.2) and taking the 
ordinary derivative with respect to x. Similarly, 


df(X) _ df (X) 


3yz + 4x, 


By = JED = 3xz 
and 
af(X) — af(X) 
= ——— = 3 2z. 
az mF. = 


The next theorem follows from the rule just given for calculating partial derivatives. 


Theorem 5.3.2 If f,,(X) and gx, (X) exist, then 
a(f + g)(X) 
OX; 


a(fg)(X) 
Ox; 


= Kei (X) + 8x; (X), 


= fr, MX) + fsx; (X), 
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and, if g(X) # 0, 
I(F/ 8X) _ 8X) fx) — fe x; (X) 
Ox; [s(x]? , 
If fx; (X) exists at every point of a set D, then it defines a function f;, on D. If this 
function has a partial derivative with respect to x; on a subset of D, we denote the partial 


derivative by 
0 (of rma 
ax; ( ) ~ Pd) Aix 


Ox; Ox; a Ox; OX; 
Similarly, 
0 a f 7 arf _ 
axK Go)  OXROX OX; Frixixe- 
The function obtained by differentiating f successively with respect to x;,,Xj,,..., Xi, 1S 
denoted by xf 


it is an rth-order partial derivative of f . 
Example 5.3.3 The function 
F(x, y) = 3x7 y? + xy 
has partial derivatives everywhere. Its first-order partial derivatives are 
felx.y) = Oxy? +y,  fy(X,y) = 9x7? + x. 

Its second-order partial derivatives are 

fex(%, y) = 6y3, fyy(x, y) = 18x2y, 

fay (x,y) = 18xy? +1, fyx(x, y) = 18xy? +1. 


There are eight third-order partial derivatives. Some examples are 


Sexy (X, y) = 18y?, Feyx(X, y) i 18y?, Sails y) = 18y?. 
Example 5.3.4 Compute f.x(0,0), fy (0,0), fry(0, 0), and fyx (0, 0) if 
(xy + xy?) sin(x — y) 

{ON =8 —aeye # (0,0), 

e (x,y) = 0,0). 


Solution If (x, y) 4 (0,0), the ordinary rules for differentiation, applied separately to 
x and y, yield 


(2xy + y*) sin(x — y) + (x? y + xy”) cos(x — y) 


x? 4+ y? 
2x(x?y + xy?) sin(x — y) (5.3.3) 
T= gbepgaye ta Ge 


Sax, y) = 
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and 
(x? + 2xy) sin(x — y) — (x*y + xy?) cos(x — y) 


x2 + y? 
2y(x?y + xy”) sin@x — y) ma 
Se oe 
(x? + y*) 
These formulas do not apply if (x, y) = (0, 0), so we find f, (0,0) and f; (0, 0) from their 
definitions as difference quotients: 


f<(0,0) = lim TOO TOD) LOY) ox Fie Oy, 


Sy, y) = 


fy (0,0) = lim £O,y) — FO, 0) = jim )=0 =0. 
y>0 y 


Setting y = 0 in (5.3.3) and (5.3.4) yields 
Ax (x,0) =0, fy(x,0) =sinx, x £0, 


sO 


hex (0, 0) = lim x(x, 0) — fr (0, 0) = 0-0 


x x—>0 x 
:0)— fr,0) _ |, sinx —0 
fyx(0,0) = lim FON OD) ii ee 
x0 x pate, : 


Setting x = 0 in (5.3.3) and (5.3.4) yields 


f.(0, y) = —siny, Sy, y) = 90, y £0, 
NY) 


Ie (0, y) — f<(0, 0) a —siny —0 _ 
SSS SS SS 


ee a a ar 
0, ~~ 0,0 . 0-0 
Fyy (0, 0) = lim fy. y) — HO,9) = lim —— =0. - 
y0 y y0 y 


This example shows that f,,(Xo) and f,(Xo) may differ. However, the next theorem 
shows that they are equal if f satisfies a fairly mild condition. 


Theorem 5.3.3 Suppose that f, fx, fy, and fy exist onaneighborhood N of (xo, yo), 
and fxy is continuous at (Xo, yo). Then fyx (Xo, Yo) exists, and 


fyx(X0, Yo) = fry (Xo, Yo). (5.3.5) 


Proof Suppose that « > 0. Choose 6 > 0 so that the open square 
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Ss = {(x, y)| lx — x0l < 8,|y — yol < 6} 
is in N and 
l fry (®,¥) — fry (Xo, Yo)| < € if (9) €.S3: (5.3.6) 
This is possible because of the continuity of fy at (xo, yo). The function 
A(h,k) = f(xo +h, yo +k) — f(xo +h, yo) — f (x0, Yo +k) + f(X0,¥0) (5.3.7) 
is defined if —5 < h, k < 5; moreover, 


A(h, k) = (xo + 4) — o(x0), (5.3.8) 


where 
o(x) = f(x, vo +k) — F(x, yo). 
Since 
b' (x) = fc, Yo +k) — f(x, 0), [xX — x0] < 4, 
(5.3.8) and the mean value theorem imply that 
A(h,k) = [fr vo + k) — fe (®, yo) A, (5.3.9) 


where X is between x9 and x9 +h. The mean value theorem, applied to f(x, y) (where X 
is regarded as constant), also implies that 


fx, Yo +k) — fe yo) = fey, Vk, 
where ¥ is between yo and yo + k. From this and (5.3.9), 
A(h, k) = fay @,Syhk. 
Now (5.3.6) implies that 


A(h, k) 


he — fry(X0, Yo)| = | fey) — fry (Xo, yo)| <e if O0<|h|,|k| <3. 


(5.3.10) 


Since (5.3.7) implies that 


tim 20) — jig FOO +b Yo +H) — Fro +h Yo) 
k>0 hk ~~ k=0 hk 
_ S (xo, Yo +k) — fo, Yo) 
— lim 2 
k->0 hk 
— fy%o +h, yo) — fy Co, yo) 
h ’ 


it follows from (5.3.10) that 


Sy (xo +h, yo) — fy (0, yo) 


] — fry(xo,¥o)| <€ if O<|h| <6. 
1 
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Taking the limit as / — 0 yields 


| fyx(X0, Yo) — fxy (Xo, Yo)| S€. 


Since € is an arbitrary positive number, this proves (5.3.5). q 


Theorem 5.3.3 implies the following theorem. We leave the proof to you (Exercises 5.3.10 
and 5.3.11). 


Theorem 5.3.4 Suppose that f and all its partial derivatives of order < r are contin- 
uous on an open subset S of R". Then 


Pata: (X) = fej, xi _ x;,(X), XeES, (5.4.11) 
if each of the variables x1, X2,..., Xn appears the same number of times in 
{Mis Migs ies et and ise ox euey Pies 


If this number is rx, we denote the common value of the two sides of (5.3.11) by 


a” F(X) 


DuFlauraaaTn” 5.3.12 
0x41 0X5? +++ OA” ( ) 
it being understood that 
O<rm<r, 1<k<n, (5.3.13) 
ntlratertm =e, (5.3.14) 


and, if rk = 0, we omit the symbol ax? from the “denominator” of (5.3.12). 


For example, if f satisfies the hypotheses of Theorem 5.3.4 with k = 4 at a point Xo in 
R” (n > 2), then 


Sexyy (Xo) = fayxy (Xo) = fryyx (Xo) = fyyxx (Ko) = fyxyx (Xo) = fyxxy (Xo), 
and their common value is denoted by 


d* f (Xo) 
Ox2dy2 ° 


It can be shown (Exercise 5.3.12) that if f is a function of (x1, x2,...,Xy) and (71, 12,...,1n) 
is a fixed ordered n-tuple that satisfies (5.3.13) and (5.3.14), then the number of partial 
derivatives tei, Xin “Xip that involve differentiation r; times with respect to x;, 1 <i <n, 
equals the multinomial coefficient 


r! 


rylrales+ry! 
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Differentiable Functions of Several Variables 


A function of several variables may have first-order partial derivatives at a point Xo but fail 
to be continuous at Xo. For example, if 


xy 


f(x,y) = 4x? + y?’ a (5.3.15) 
0, (x, y) = (0,9), 
then 
1 £4,0)-— f0,0) _ ., 0-0 _ 
a al a a 
and 


fO.k)— f.0) _ 0-0 _ 4 
— =0, 


0,0) = li 
fy( ) ko k k->0 


but f is not continous at (0, 0). (See Examples 5.2.3 and 5.2.11.) Therefore, if differentia- 
bility of a function of several variables is to be a stronger property than continuity, as it is 
for functions of one variable, the definition of differentiability must require more than the 
existence of first partial derivatives. Exercise 2.3.1 characterizes differentiability of a func- 
tion f of one variable in a way that suggests the proper generalization: f is differentiable 


at Xo if and only if 
smn LOD = 0) = mx = x0) _ 


li 0 

x>X0 x — Xo 
for some constant m, in which case m = f’(x0). 

The generalization to functions of n variables is as follows. 

Definition 5.3.5 A function f is differentiable at 
Xo = (X10, X20,---,Xno)) 

if Xo € D‘. and there are constants m1, m2, ..., My such that 

n 
F(X) — f (Xo) — )5 mi (xi — xio) 
im —————__—*"__ = 0, (5.3.16) 


X—>Xo [X = Xo| 


Example 5.3.5 Let 
f(x,y) = x? + 2xy. 


We will show that f is differentiable at any point (xo, yo), as follows: 
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I, y) = f (Xo; Yo) = a + 2xy -x — 2xo0yo 


x? — xe + 2(xy — xoyo) 


II 


(x — xo)(x + Xo) + 2(xy — xoy) + 2(xoy — Xoo) 

= (x + X0 + 2y)(x — x0) + 2x0(y — yo) 

= 2(xo + yo)(x — x0) + 2x0(y — yo) 

+ (x — xo)(X — X0 + 2y —2yo) 

= m (x — Xo) +m2(y — yo) + (& — X0)(x — x0 + 2y — 2yo), 

where 
m, =2(x0 + yo) = fx(Xo. Yo) and mz = 2x0 = fy(Xo, yo). (5.3.17) 

Therefore, 


| f(x,y) — fo, Yo) — m1 (x — Xo) — ma(y — Yo) | = |x — xo||(% — xo) + 2(y — yo)| 
|[X — Xo| [X — Xo| 


< V5|X — Xol, 
by Schwarz’s inequality. This implies that 


i I(x, y) — f (Xo, Yo) — m1 (% — Xo) — M2(y — yo) _ 
mC = 


0, 
X>Xo |X — Xo| 


so f is differentiable at (xo, yo). a 


From (5.3.17), m; = fx(xo, Yo) and mz = fy(xo, yo) in Example 5.3.5. The next 
theorem shows that this is not a coincidence. 


Theorem 5.3.6 If f is differentiable at Xo = (X10,X20,---,Xno), then fx, (Xo), 
Feo (Xo), ---5 Ay (X0) exist and the constants my, m2, ..., My in (5.3.16) are given by 


mi = fx;(Xo), Li <n; (5.3.18) 
that is, 


F(X) — f (Ko) — > fe; Ko)(xi — xi0) 


lim | ——=! XN, 
X>Xo |X — Xo| 


Proof Let i bea given integer in {1,2,...,}. Let X = Xo + ¢E;, so that x; = xjo +1, 
x; = xjo if j Ai, and |X — Xo| = |t|. Then (5.3.16) and the differentiability of f at Xo 
imply that 

lim f (Xo + tE;) — f(Xo) — mit 


t>0 t 


=0. 


Section 5.3 Partial Derivatives and the Differential 325 


Hence, 
_ f (Xo + tE;) — f(Xo) 
lim, —— A? _ = 
t>0 t 
This proves (5.3.18), since the limit on the left is f,, (Xo), by definition. an 


A linear function is a function of the form 
L(X) = myx1 + m2XxX2 + +++ + MnXn, (5.3.19) 


where m1, m2, ..., Mn are constants. From Definition 5.3.5, f is differentiable at Xo if 
and only if there is a linear function L such that f(X) — f(Xo) can be approximated so 
well near Xo by 

L(X) — L(Xo) = L(X — Xo) 


that 
S(X%) — f (Xo) = L(X — Xo) + E(%)(|X — Xo)), (5.3.20) 
where 
Buus E(X) = 0. (5.3.21) 


Theorem 5.3.7 If f is differentiable at Xo, then f is continuous at Xo. 


Proof From (5.3.19) and Schwarz’s inequality, 
|L(X — Xo)| < M|X — Xo], 


where 
M = (mj +m} feet my, 


This and (5.3.20) imply that 
| F(X) — f(Xo)| < (M + |E(X)))[X — Xo], 


which, with (5.3.21), implies that f is continuous at Xo. an 


Theorem 5.3.7 implies that the function f defined by (5.3.15) is not differentiable at 
(0,0), since it is not continuous at (0,0). However, f,(0,0) and (0,0) exist, so the 
converse of Theorem 5.3.7 is false; that is, a function may have partial derivatives at a 
point without being differentiable at the point. 


The Differential 


Theorem 5.3.7 implies that if f is differentiable at Xo, then there is exactly one linear 
function L that satisfies (5.3.20) and (5.3.21): 


L(X) = fx Xo)x1 + fr Xo)x2 +++ + fren KO) Xn- 
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This function is called the differential of f at Xo. We will denote it by dx, f and its 
value by (dx, f)(X); thus, 


(dxy f)(X) = Sey (Xo)x1 + Tica (Xo) x2 a aa Son (Xo)xXn. (5.3.22) 
In terms of the differential, (5.3.16) can be rewritten as 


i F(X) — f (Ko) = xo f)(K = Xo) _ 
in —_—__e CE 


0. 
X>Xo [X = Xo| 


For convenience in writing dx, f, and to conform with standard notation, we introduce 
the function dx;, defined by 
dxj(X) = xi; 


that is, dx; is the function whose value at a point in R” is the ith coordinate of the point. It 
is the differential of the function g;(X) = x;. From (5.3.22), 


Axo f = fx, (Ko) dx1 + fay (Ko dx2 + +++ + fen (Ko) dxn. (5.3.23) 
If we write X = (x, y,...,), then we write 
dxo f = fx(Ko) dx + fy(Ko)dy +---, 
where dx, dy, ... are the functions defined by 
dx(X)=x, dy(X)=y,... 


When it is not necessary to emphasize the specific point Xo, (5.3.23) can be written more 
simply as 
df = fx, dX1 + feo dx2 +++++ fr, AXn. 


When dealing with a specific function at an arbitrary point of its domain, we may use the 
hybrid notation 


df = fry (X)dx1 + feo (KX) dx2 +++ + fay (X&) xn. 
Example 5.3.6 We saw in Example 5.3.5 that the function 
F(x, y) =x? + 2xy 
is differentiable at every X in R”, with differential 
df = (2x +2y)dx + 2x dy. 
To find dx, f with Xo = (1, 2), we set x9 = 1 and yo = 2; thus, 
dx, f =6dx+2dy 


and 
(dx f)(X — Xo) = 6(x — 1) + 2(y — 2). 
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Since f(1, 2) = 5, the differentiability of f at (1,2) implies that 
fe. y) 5 — 6(x - 1) = 2-2) _ 


lim 
(x,y) (1,2) /(x = 1)? + (y = 2)? 


Example 5.3.7 The differential of a function f = f(x) of one variable is given by 


dx f = f' (xo) dx, 


where dx is the identity function; that is, 


0. 


dx(t) =t. 


For example, if 
f(x) = 3x? + 5x3, 


then 
df = (6x + 15x?) dx. 


If x9 = —1, then 
dxf =9dx, (dxo f(x — xo) = Wx + 1), 
and, since f(—1) = —2, 


— f(x) +2-9% +1) 
lim ————————_ = 0 
x1 x+1 


Unfortunately, the notation for the differential is so complicated that it obscures the 
simplicity of the concept. The peculiar symbols df, dx, dy, etc., were introduced in 
the early stages of the development of calculus to represent very small (“‘infinitesimal’’) 
increments in the variables. However, in modern usage they are not quantities at all, but 


linear functions. This meaning of the symbol dx differs from its meaning in /' i F(x) dx, 
where it serves merely to identify the variable of integration; indeed, some authors omit it 


: 7 : b 
in the latter context and write simply / Rod « 


Theorem 5.3.7 implies the following lemma, which is analogous to Lemma 2.3.2. We 
leave the proof to you (Exercise 5.3.13). 


Lemma 5.3.8 If f is differentiable at Xo, then 
f(X) — f(Xo) = (dx f (XK — Xo) + E(X)|X = Xo, 
where E is defined in a neighborhood of Xo and 
oS E(X) = E(X%o) = 0. 


Theorems 5.3.2 and 5.3.7 and the definition of the differential imply the following 
theorem. 
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Theorem 5.3.9 /f f and g are differentiable at Xo, then so are f + g and fg. The 
same is true of f/g if g(Xo) 4 0. The differentials are given by 


dx. (f +g)= dx f oe dxy&, 
dxo (fg) = f(®o)dxog + g(Xo)dxy fo 


d (4) _ &(Xo)dxo f — f(Xo)dxog 
X60 PS he 
S [g(Xo)]* 


and 


The next theorem provides a widely applicable sufficient condition for differentiability. 


Theorem 5.3.10 If fx, feo,---+ Sey exist on a neighborhood of Xo and are contin- 
uous at Xo, then f is differentiable at Xo. 


Proof Let Xo = (x10, X20,...,Xno) and suppose that « > 0. Our assumptions imply 
that there is a 5 > 0 such that fy,, fi.,..., fx, are defined in the n-ball 


Ss(Xo) = {X| |X — Xo| < 5} 


and 
Ife) — fe; Ko) <€ if (K-Xol <6, 1sj<n. (5.3.24) 


Let X = (x1,X,...,Xn) be in Ss(Xo). Define 


Xj = (41,..-,X7,Xj41,05---,Xn0); l<j<n-l, 


and X, = X. Thus, for 1 < j <n, X; differs from X;—; in the jth component only, and 
the line segment from X;_1 to X; is in Ss (Xo). Now write 


n 
F(X) — f (Xo) = f (Kn) — f(%o) = Yo LF (Ks) — f(Kj-1)], (5.3.25) 
j=l 
and consider the auxiliary functions 
gilt) = F(t, X20, sd ,Xno); 
gj(t) = JF Os es Repel hy LO ved $tn0) 5 2< J <n-l, (5.3.26) 
&nl(t) = fa, esce8 Xn-1; t), 
where, in each case, all variables except t are temporarily regarded as constants. Since 
F(X) — f(Xj-1) = 85s) — 8; (jo), 
the mean value theorem implies that 


f(&j) — f(Kj-1) = 8) (ty) (xj — Xj), 
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where 1; is between x; and x jo. From (5.3.26), 
gj (tj) = fr; (Xj), 
where X ; 1s on the line segment from X;_; to X;. Therefore, 


F(X) — f(Xj-1) = fe; (K(x; — xj0), 
and (5.3.25) implies that 


n 


F(X) — f (Ko) = D> fe, Ks) Oxj — x70) 


j=l 
= > Sx; (Xo)(xj — xjo) + > Lfx;(&j) — fe; Xo) (xj — x;0). 
j=l j=l 


From this and (5.3.24), 


n n 
F(X) — f (Xo) — > fr; Ko(xj — xj0)| < € Yo [xy — x jo] <ne|X — Xol, 
j=1 j=l 
which implies that f is differentiable at Xo. 0 


We say that f is continuously differentiable on a subset S of R” if S is contained in an 
open set on which fy,, feo, ..-, fx, are continuous. Theorem 5.3.10 implies that such a 
function is differentiable at each Xo in S. 


Example 5.3.8 If 


x? 4572 
f(x, y) = ——., 
x—y 
then 
2x x? + y? 2y x? + y? 
f(x,y) = -——, and fp, y) = 


x-y (x-y)? R=y (ay 


Since f; and f, are continuous on 
S =x, y)|x AY}. 
f is continuously differentiable on S. 
Example 5.3.9 The conditions of Theorem 5.3.10 are not necessary for differentiabil- 


ity; that is, a function may be differentiable at a point Xo even if its first partial derivatives 
are not continuous at Xo. For example, let 


: 1 
f(x,y) = (x — y)? sin — y? x#Y, 


0, x=y. 
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Then 


1 
Ax (x, y) = 2(x — y) sin — cos , xy, 
x—y 


Mera y 


and 
me Ce hee oer Geer h? sin(1/h)—0 _ 
ses h Sie h oe 


so f; exists for all (x, y), but is not continuous on the line y = x. The same is true of fy, 
since 


1 
fy@, y) = —2(@ — y) sin EOS ey x#Y, 


x—y 


and 


F(x, x +k) — f(x,x) _ 


. _ k* sin(—1/k) —0 
fy @, x) = lim k lim ——————. = 


k->0 k 


Now, 


_ 2 
Fle.y)— (0,0) — fe(0.0)x— fy0.0y _ [SEX sin +, x zy, 


aay eee x—y 
and Schwarz’s inequality implies that 


(&x-y? . 1 


oS sn 
Aye Ey 


2 2 
— 27 + y*) 


= eee 


=:2. x24 y?, xA#y. 


Therefore, 


li S(x,y) — f,0) — f,(0, 0)x — f, (0, Oy = 
ym 


(x,y) > (0.0) [xe + y2 


so f is differentiable at (0,0), but f; and f, are not continuous at (0, 0). 


0, 


Geometric Interpretation of Differentiability 


In Section 2.3 we saw that if a function f of one variable is differentiable at xo, then the 
curve y = f(x) has a tangent line 


y = T(x) = f (xo) + f’o)(x — Xo) 
that approximates it so well near xo that 


km JAP) _ 
im —————— = 


x—>Xx0 xX —X0o 


0. 


Moreover, the tangent line is the “limit” of the secant line through the points (x1, f(xo)) 
and (xo, f(Xo)) as x1; approaches xo. 
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Zz 
~ z=f(% y) 
y 
x 


Figure 5.3.1 


Differentiability of a function of n variables has an analogous geometric interpretation. 
We will illustrate it for n = 2. If f is defined in a region D in R?, then the set of points 
(x, y, Z) such that 

z=f (x,y), (x,y) €D, (5.3.27) 


is a surface in R? (Figure 5.3.1). 


Figure 5.3.2 


If f is differentiable at Xo = (xo, yo), then the plane 
z=T(x,y) = f(Ko) + fx(Ko)(x — x0) + fy(X%o)(y — yo) (5.3.28) 


intersects the surface (5.3.27) at (xo, yo, f(Xo, Yo)) and approximates the surface so well 
near (Xo, Yo) that 
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li S(x,y) -~T(x, y) on 
im ——_———————— = 
(x.y)>(0,90) ./(x — x0)? + (y — yo)? 

(Figure 5.3.2). Moreover, (5.3.28) is the only plane in R? with these properties (Exer- 
cise 5.3.25). We say that this plane is tangent to the surface z = f(x,y) at the point 
(xo, Yo, f (Xo, Yo)). We will now show that it is the “limit” of “secant planes” associated 
with the surface z = f(x, y), just as a tangent line toacurve y = f(x) in R? is the limit 
of secant lines to the curve (Section 2.3). 


Let X; = (4%, vj) @ = 1,2,3). The equation of the “secant plane” through the points 
(xi, yi, f(xi, vi)) @ = 1,2, 3) on the surface z = f(x, y) (Figure 5.3.3) is of the form 


z= f (Xo) + AQ — x0) + Bly — yo), (5.3.29) 
where A and B satisfy the system 


SF (&1) = f (Ko) + A(x — X0) + BO — yo), 
Sf (X2) = f(Xo) + A(x2 — x0) + B(y2 — Yo). 


Solving for A and B yields 
_ (F(X) — f(XKo))(y2 = yo) — (F(K2) ~— f(Xo)) (v1 = yo) 


A 3. 
== Po 
and 
B= (f (X2) — I (Xo))(%1 —_ Xo) — (f(X1) _ f (Xo)) (x2 — xo) (5.3.31) 
(x1 — xo)(¥2 — Yo) — (x2 — x0)(¥1 — yo) 
if 
(x1 — X0)(2 — Yo) — (x2 — X0)(¥1 — Yo) # 9, (5;3.32) 


which is equivalent to the requirement that Xo, X;, and Xz do not lie on a line (Exer- 
cise 5.3.23). If we write 


X; =Xo+?tU and X,=Xj)+V, 


where U = (u1,uU2) and V = (v1, v2) are fixed nonzero vectors (Figure 5.3.3), then 
(5.3.30), (5.3.31), and (5.3.32) take the more convenient forms 


f(Xo + 1U) SIS), f (Xo + tV) = 


A=—__ (5.3.33) 
u,v2 —Uu2v1 


f(Ko+tV)= fXo) fo +1U) = f%o) 


RS _f______i_t_ei___s—. (5.3.34) 
u,v2 —Uu2v1 


and 
uy ,Vv2 —U2V1 x 0. 
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Figure 5.3.3 


If f is differentiable at Xo, then 


F(X) — f(Xo) = fr Ko) — x0) + fy (X0)(y — yo) + €(X)|X — Xo], (5.3.35) 


where 
lim ¢€(X) = 0. (5.3.36) 
xX—Xo 


Substituting first X = Xo +7¢U and then X = Xp + ¢V in (5.3.35) and dividing by t yields 


Ff (¥o + tU) — f(Xo) 


; = fx(Xo)ur1 + fy(Ko)u2 + E1(t)|U| (5.3.37) 
~ X V X 
Let) — Pe) = fc(%o)vi + fy(Ko)v2 + E2(1)|V], (5.3.38) 
where 
Ex(t) =e€(Xo + ¢U)|t|/t and E(t) = (Xo + ¢tV)I|t|/t, 
sO 


lim E(t) =0, i=1,2, (5.3.39) 
because of (5.3.36). Substituting (5.3.37) and (5.3.38) into (5.3.33) and (5.3.34) yields 
A= fx(Ko) + Ait), B= fy(Xo) + Ar(d), (5.3.40) 


where 
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v2|U| Ei (t) — u2|V|E2(@) 


Ai(t) = 
U1, V2 —U2U1 
ae VIE Ul|E 
t)— t 
Aije |E2(t) — vi |U| 1) 
u,v2 —Uu2VU1 
so 
lim Aj(t)=0, i = 1,2, (5.3.41) 
t> 


because of (5.3.39). 
From (5.3.29) and (5.3.40), the equation of the secant plane is 


z= f(Xo) + [fr (Ko) + Ar] — x0) + [fy Ko) + Ar)](y — yo). 


Therefore, because of (5.3.41), the secant plane “approaches” the tangent plane (5.3.28) as 
t approaches zero. 


Maxima and Minima 

We say that Xo is a local extreme point of f if there isa dé > 0 such that 
F(X) — f(Xo) 

does not change sign in Ss(X9) N D ¢. More specifically, Xo is a local maximum point if 
F(X) = f (Xo) 


or a local minimum point if 
F(X) = f(Xo) 
for all X in Ss(Xo) N Dy. 


The next theorem is analogous to Theorem 2.3.7. 


Theorem 5.3.11 Suppose that f is defined in a neighborhood of Xo in R” and f,, (Xo), 
Fo (Xo), --- 5 Ac, (Xo) exist. Let Xo be a local extreme point of f. Then 


fx; %o) =0, 1sisn. (5.3.42) 
Proof Let 
E; = (1,0,...,0), E: =(0,1,0,...,0),...,. Ey = (0,0,...,1), 


and 
gi(t) = f(Xo +tE;), 1 <i <n. 


Then g; is differentiable at t = 0, with 


g; (0) = tej (Xo) 
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(Definition 5.3.1). Since Xo is a local extreme point of f, t9 = 0 is a local extreme point 
of g;. Now Theorem 2.3.7 implies that g/(0) = 0, and this implies (5.3.42). 0 


The converse of Theorem 5.3.11 is false, since (5.3.42) may hold at a point Xo that is 
not a local extreme point of f. For example, let Xo = (0, 0) and 


f@y=xPty?. 


We say that a point Xo where (5.3.42) holds is a critical point of f. Thus, if f is defined 
in a neighborhood of a local extreme point Xo, then Xo is a critical point of f{; however, a 
critical point need not be a local extreme point of /. 


The use of Theorem 5.3.11 for finding local extreme points is covered in calculus, so we 
will not pursue it here. 


5.3 Exercises 


1. Calculate df (X)/0®. 


(a) f(x,y) = x? + 2xy cosx, o-(=.-/3) 
1 


2 1 1 
b — p—xt+y*+2z SF i 
(b) faxn=errt*, & (=. Fe :) 
1 1 1 
(c) f(X) = |XP, e-(— =) 
(d) f(x,y.z) =logi+x+y+z), © =(0,1,0) 
2. Let : 
xy sinx 
(y= ae age (x, y) F (0,0), 
0, (x,y) = (0,0), 


and let ® = (1, ¢2) be a unit vector. Find df (0, 0)/d®. 
3. Find df (Xo)/0®, where ® is the unit vector in the direction of X; — X). 
(a) f(x, y,z) =sinaxyz; Xo =(1,1,-2), X1: = G,2,-1) 
(b) f(x, y,z) =e? 497420); X= (1,0,-1), Xi = (2,0,-1) 
(c) f(x, y.2) =log(l+x+y+z); Xo =(1,0,1), Xi = G,0,-1) 
(d) f(X) =|X/*; Xo=0, X,=(1,1,...,) 
4. Give a geometrical interpretation of the directional derivative 0f (x0, yo)/0® of a 
function of two variables. 


5. Find all first-order partial derivatives. 
(a) f(x, y,2) = log(x + y +22) (b) f(x, y, 2) = x7 + 3xyz + 2xy 


(c) f(x, y,z) = xe¥? (d) f(x, y,z) =z +sinx?y 
6. Find all second-order partial derivatives of the functions in Exercise 5.3.5. 
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7. Find all second-order partial derivatives of the following functions at (0, 0). 


xy(x? — y? 
(a) f@ yal gpp 7 HY FOOS, 
0, (x, y) = (0,0) 
Qtag bY 2 pgm © 
Crepe a eg eee ae 
0 x=0 or y=0 


(Here | tan~! u| < 1/2.) 


8. Find a function f = f(x,y) such that fLy exists for all (x,y), but fy exists 
nowhere. 


9. Let wu and v be functions of two variables with continuous second-order partial 
derivatives in a region S. Suppose that ux = vy anduy = —v, in S. Show 
that 

Uxx +Uyy = Vxx + Vyy = 0 
in S. 
10. Let f bea function of (x1, X2,...,Xn) (n = 2) such that f;, fr;,and fr;x; i # 
j) exist on a neighborhood of Xo and fy; x j is continuous at Xo. Use Theorem 5.3.3 
to prove that fy ; x; (Xo) exists and equals fy; ; (Xo). 


11. Use Exercise 5.3.10 and induction on r to prove Theorem 5.3.4. 


12. Letr,,r2,..., 7, be nonnegative integers such that 
rmtrate +r =r =. 
(a) Show that 


r! r 


T2 r 
Zit fate ten)" = Yai cr, 
: ” — rylra! ery) 2 Om 
where }°, denotes summation over all n-tuples (1, r2,...,/n) that satisfy 


the stated conditions. HINT: This is obvious ifn = 1, and it follows from 
Exercise 1.2.19 ifn = 2. Use induction on n. 


(b) Show that there are 


r! 
ordered n-tuples of integers (i1,i2,...,i,) that contain r; ones, rz twos, ..., 
and ry, n’s. 
(c) Let f bea function of (x1, x2, ..., Xn). Show that there are 
r! 


partial derivatives tei, Xin 
tox;,fori = 1,2,...,n. 


13. Prove Lemma 5.3.8. 


Kip that involve differentiation 7; times with respect 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


21. 
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Show that the function 
x?y 
fa aay 
0, (x,y) = (0,0), 


has a directional derivative in the direction of an arbitrary unit vector ® at (0, 0), but 

f is not continuous at (0, 0). 

Prove: If f; and f, are bounded ina neighborhood of (x9, yo), then f is continuous 

at (Xo, Vo). 

Show directly from Definition 5.3.5 that f is differentiable at Xo. 

(a) f(x,y) = 2x7 + 3xy+y?, Xo = (1,2) 

(b) f(x, y,z) = 2x? +3x4+4yz, Xo =(1,1,1) 

(c) f(X) =|X|?, Xo arbitrary 

Suppose that f; exists on a neighborhood of (xo, yo) and is continuous at (x0, yo), 

while /, merely exists at (xo, yo). Show that f is differentiable at (xo, yo). 

Find df and dx, f, and write (dx, f)(X — Xo). 

(a) f(x,y) =x? +4xy? + 2xysinx, Xo = (0,—2) 

(b) f@y2Se°O?™, Xo =@,0,0) 

(c) f(X) = log(] +.x1 +2x2 + 3x3 +-+-+nxXn), Xo =0 

(d) 70) = |x") Xp — Gals) 

(a) Suppose that f is differentiable at Xo and ® = (9), ¢2,...,¢n) is a unit 
vector. Show that 

df (Xo) 
o® 


= Fe (Xo)¢1 =F Feo (Xo) G2 aie a Fen (Xo)¢n. 


(b) For what unit vector ® does df (Xo)/0® attain its maximum value? 
Let f be defined on R” by 


F(X) = 9(%1) + g(xX2) +++ + 8(%n), 


where 

u? sin z u #0, 

0, . u=0 

Show that f is differentiable at (0,0,...,0), but fx,, fro, ---» fx, are all discon- 
tinuous at (0,0,..., 0). 


g(u) = 


The purpose of this exercise is to show that if f, f; and fy exist on a neighborhood 
N of (xo, yo) and f; and fy are differentiable at (xo, yo), then fyy(x0, Yo) = 
yx (Xo, Yo). Suppose that the open square 


{(x, y) | lx —xol < IAI, Ly — yol < lal} 
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22. 


23. 


24. 


is in N. Consider 


Boh) = f(xo +h, yo +h) — f(%o +h, yo) — f(%o, Yo + h) + f (Xo, yo). 


(a) Use the mean value theorem as we did in the proof of Theorem 5.3.3 to write 


B(h) = [fc yo +k) — fe &, yo) h, 


where X is between x9 and x9 + h. Then use the differentiability of fy at 
(Xo, Yo) to infer that 


B(h) = Nh? fry(X0, Yo) +HEi (A), where H 7 
—>0 i] 


(b) Use the mean value theorem to write 


B(h) = [fyto +h, 3) — fy Xo. D)] A, 


where ¥ is between yo and yo +. Then use the differentiability of f, at 
(Xo, Yo) to infer that 


Ex(h) _ 5 


B(h) = h? fyx (xo, Yo) + hE2(h), where on 
—>0 
(c) Infer from (a) and (b) that f¢y (x0, yo) = fyx (Xo, Yo). 


(a) Let f;, and f,, be differentiable at a point Xo in R”. Show from Exer- 
cise 5.3.21 that 


Sijx; (Xo) = Se xj (Xo). 


(b) Use (a) and induction on r to show that all (r — 1)-st order partial derivatives 
of f are differentiable on an open subset S of R”, then tei, Xig“Xip (X) (X € S) 
depends only on the number of differentiations with respect to each variable, 
and not on the order in which they are performed. 


Prove that (xo, Yo), (X1, ¥1), and (x2, y2) lie on a line if and only if 
(x1 — Xo)(¥2 — Yo) — (2 — X0)(1 — Yo) = 0. 
Find the equation of the tangent plane to the surface 
z= f(x,y) at (Xo, Yo, Z0) = (Xo, Yo, f (Xo, Yo)). 


(a) f(x,y) =x?+y?-1, (Xo, yo) = (1,2) 

(b) f(x,y) =2x+3y+1, (xo, yo) = (1, -1) 
(c) f(x,y) =xysinxy, (xo, yo) = (1, 2/2) 

(d) f(x,y) =x?—2y?+3xy, (x0, yo) = 2,—1) 
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25. Prove: If f is differentiable at (xo, yo) and 


hm L¥) =a = Bx = x0) — (= Yo) _ 
im a 


(x,y)>(x0.¥0) V(x — x0)? + (y — yo)” 


thena = f (xo, yo), b = fx(Xo, Yo), andc = fy(Xo, Yo). 


0, 


5.4 THE CHAIN RULE AND TAYLOR’S THEOREM 


We now consider the problem of differentiating a composite function 


h(U) = f(GU)), 


where G = (81, 2,.--, %n) iS a vector-valued function, as defined in Section 5.2. We 
begin with the following definition. 


Definition 5.4.1 A vector-valued function G = (g1, g2,..., Zn) is differentiable at 
Uo = (U10, 20, ---,Umo) 


if its component functions g1, g2,..., Yn are differentiable at Up. | 
We need the following lemma to prove the main result of the section. 


Lemma 5.4.2 Suppose that G = (g1, g2,..-, Zn) is differentiable at 
Uo = (W410, U20,---,Umo), 


and define 


Then, if € > 0, there is a dé > 0 such that 


|G(U) — GUo)| 


<M+ if O<|U—Up| <6. 
[U— Uo e if | 0| 


Proof Since g1, g2,..., Zn are differentiable at Uo, applying Lemma 5.3.8 to g; shows 
that 


gi(U) — gi (Uo) = (dup gi)(U — Uo) + E;(U)|(U — Uo| 


s: | 5.4.1 
= 57 OO) 6 | — 49) + EU) —Ual, = 
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where 
lim £;(U)=0, 1<i<n. (5.4.2) 
U-Uo 


From Schwarz’s inequality, 


|gi(U) — g;(Uo)| < (Mi + |E;(U)|)|U — Uo], 


where ie 
u, = (So (280) 
a 2 Dips 
j=l ? 
Therefore, 
GU) - GUo)| _ (< = 
_ 5 ‘ 
< M; + |£E;(U ; 
TU Ue (> i + Ei w*) 
From (5.4.2), 
ss 1/2 x 1/2 
a (sya ag 10? = (> ue) = M, 
° \i=1 i=1 
which implies the conclusion. 0 


The following theorem is analogous to Theorem 2.3.5. 


Theorem 5.4.3 (The Chain Rule) Suppose that the real-valued function f is 
differentiable at Xo in R” , the vector-valued functionG = (g1, 82,..., &n) is differentiable 
at Up in R™, and Xo = G(Uo). Then the real-valued composite functionh = f oG defined 
by 

h(U) = f(G()) (5.4.3) 


is differentiable at Uo, and 
duh = fr, Xo0)dug 81 + Seo Xo)dug 82 +++ + fen Ko) dug Sn- (5.4.4) 


Proof We leave it to you to show that Up is an interior point of the domain of h (Exer- 
cise 5.4.1), so it is legitimate to ask if h is differentiable at Uo. 


Let Xo = (%10, X20,.--, Xno). Note that 
Xi0 = 8i(Uo), 1<i <n, 
by assumption. Since f is differentiable at Xo, Lemma 5.3.8 implies that 
n 
F(X) — f (Ko) = > fe; Ko) (xi — x10) + E(K)|X — Xol, (5.4.5) 
i=1 


where 
lim E(X) =0. 
X—Xo 
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Substituting X = G(U) and Xp = G(Up) in (5.4.5) and recalling (5.4.3) yields 


h(U) — ho) = 95 fr; &o)(gi (U) — gi (Uo)) + E(GU))|GU) —GUo)|. 5.4.6) 


i=1 


Substituting (5.4.1) into (5.4.6) yields 


h(U) — ho) = S° fx; Ko) (duo gi)(U — Uo) + (>: fx; %o) Ei «)) |U — Uo| 
i=1 i=1 
+E(G(U))|G(U) — GU). 
Since 
lim EGU) = lim EC = 0, 


(5.4.2) and Lemma 5.4.2 imply that 


h(U) — ho) — Y> fe; Xodv gi (U — Uo) 
i=1 


|U — Uo| 
Therefore, h is differentiable at Uo, and dy,/ is given by (5.4.4). an] 


=0. 


Example 5.4.1 Let 
f(%, y,Z) = 2x? + 4xy + 3yz, 


gi(u,v) = u? +07, g2(u,v) = u? —2v?, g3(u,v) = uv, 


and 
hu, v) = S(gitu, v), go(u, v), g3(u, v)). 
Let Up = (1, —1) and 


Xo = (g1(Uo), 2(Uo), g3(Uo)) = (2, -1, -1). 


Then 
Ix (Xo) = 4, fy (Ko) =5,  fe(Ko) = -3, 
dgi(Uo) __ , — 981(Uo) _ 
dues dv 
dg2(Uo) ane dg2(Uo) = 2 
ou dv 
dg3(Uo) _ 4 dg3(Uo) _ 
ues‘ dv 
Therefore, 


dup g1 = 2du—2dv, 


duy&2 =2du+4dv, 


duyg3 = —du+dv, 
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and, from (5.4.4), 
duh = fx(Xo) dup8i + fy (Xo) dup 82 + fz (Xo) duo 83 
= 4(2du —2dv)+5(2du + 4dv) —3(—du + dv) 
=21du+9dv. 


Since 
dugh = hy, (Up) du + hy(Up) du 


we conclude that 
hy(Up) = 21 and h,(Up) = 9. (5.4.7) 


This can also be obtained by writing / explicitly in terms of (uw, v) and differentiating; thus, 
h(u, v) = 2[gi (u,v)? + 4gi(u, v)g2(u, v) + 3g2(u, v)g3(u, v) 
= 2(u? + v2)? + A(u? + v?)(u? — 20?) + 3(u? — 2v?)uv 
= 6u* + 3u3v — 6uv? — 6v4. 
Hence, 
hy(u, v) = 24u3 + 9u7v —6v? and hy (u, v) = 3u3 — 18uv? — 24v?, 
so hy (1, -1) = 21 and h,(1, —1) = 9, consistent with (5.4.7). 
Corollary 5.4.4 Under the assumptions of Theorem 5.4.3, 


dh(Uo) _ “\ Of (Xo) Ag; (Uo) 


, L<i<nm. 5.4.8 
Ou; : Ox; Ou; ave ( ) 
j=1 , 
Proof Substituting 
Je; Je; 
dup 8i = $giUo) ieee CE i a gio) m Sin 
uy dur Um 


into (5.4.4) and collecting multipliers of du;, duz2,..., dum yields 


“(SG Of (Ko) ag; (Uo) 
duh = pS > ax; iin duj. 
i=1 \j=1 


However, from Theorem 5.3.6, 


dyh = \~ ay) du;. 


u 
i=l F 


Comparing the last two equations yields (5.4.8). 0 
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When it is not important to emphasize the particular point Xo, we write (5.4.8) less 
formally as 


sa, l<i<m, (5.4.9) 


with the understanding that in calculating dh(Uo)/du;, 0g;/du; is evaluated at Up and 
Of /Ox; at Xp = G(U9). 
The formulas (5.4.8) and (5.4.9) can also be simplified by replacing the symbol G with 
X = X(U); then we write 
A(U) = f(X)) 


and 
dh(Up) z ‘ df (Xo) dx; (Uo) 
Ou; Oxy; Ou” 
or simply 
oh = Of dx; 
eee mul eee Al 
Ou; dX Ox; Ou; © ” 


Example 5.4.2 Let (r, 0) be polar coordinates in the x y-plane; that is, 
x=rcosé, y=rsiné. 
Suppose that f = f(x, y) is differentiable on a set S, and let 
h(r, 0) = f(r cos @,r sin@). 
If (r cos 0, rsin@) € S, (5.4.10) implies that 
dh _ of ax of ay = 


af af 


ele neue cela All 
or oxor  doyoar RM Ox ay oy 6 ) 
and 
dh of dx  dafdy _ . Boa. g of 
é6. ax00  dyf0 8°” Ox Oy’ 
where f, and fy are evaluated at (x, y) = (r cos 6,r sin@). a 


The proof of Corollary 5.4.4 suggests a straightforward way to calculate the partial 
derivatives of a composite function without using (5.4.10) explicitly. If h(U) = f(X(U)), 
then Theorem 5.4.3 , in the more casual notation introduced before Example 5.4.2, implies 
that 

dh = fr,dx1 + fegdxo ++->+ fp xn, (5.4.12) 


where dx 1, dx2, ..., dX» must be written in terms of the differentials du,, duz,..., dum 
of the independent variables; thus, 
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OX; OX; OX; 
to ae ae 


Substituting this into (5.4.12) and collecting the multipliers of dui, duz,... 


Example 5.4.3 If 
A(r, 8,2) = f(x(r, 9), yr, 8), 2), 


, dUm yields (5.4.10). 


then 
dh = f,dx + fydy + fzdz. 
ae ax ax 3 3 
_ Ox ax _ ay y 
dx a dr + = d6 and dy = ap dr + a, 40; 
hence, 
dh =f, arts *d0)+f wars od d0\+ frd 
=e ne y 00 ane 
a +h 2) dr (0 +fh= a) d+ fede 
SO 


_ Ox oy _ , Ox oy _ 
hr = fea + faz he = txaq + frag: hz = fz. 


Example 5.4.4 Let 


h(x) = f(x, y (x, 2()), Z(x)). 
Then 


dh= f,.dx+ fydy+ f,dz, 
dy = yx, dx + yz dz, 

and 
dz=2z' dx, 


(5.4.13) 
(5.4.14) 


(5.4.15) 


where the prime indicates differentiation with respect to x. Substituting (5.4.15) into 


(5.4.14) yields 
dy = (yx + yzz') dx 
and substituting this and (5.4.15) into (5.4.13) yields 


dh = [fx + fy(vx + y22') + fez] dx; 
hence, 
h’ = tx + fy x + y22') + fez’. 


Here fy, fy, and fz are evaluated at (x, y(x, z(x)),Z(x)), yx and yz are evaluated at 


(x, z(x)), and z’ is evaluated at x. 


Section 5.4 The Chain Rule and Taylor’s Theorem 345 


Higher Derivatives of Composite Functions 


Higher derivatives of composite functions can be computed by repeatedly applying the 
chain rule. For example, differentiating (5.4.10) with respect to uz yields 


Mh yt (atin) 


dugduj; dug \ Ox; Ou; 
is (5.4.16) 
_ “Lin af a? Xj Le Ox; 7) = 
{ Ox; OUK Uj du; duK 
We must be careful finding 
0 of 
duzx \ Ax; J? 
which really stands here for 
: gi) (5.4.17) 
OuK Ox; 
The safest procedure is to write temporarily 
Of (X) 
ee) = LO. 
j 
then (5.4.17) becomes 
dg(X(U)) _ 3 dg(X(U)) dx5(U) 
OUR = OXs Ou 
Since 
dg a7 f 
OX, OXs Oxy 
this yields 
0 (= of i ay eT Os 
dug \Ox~ HF OX Ox; OUR 
Substituting this into (5.4.16) yields 
7h af dx; “Oxi wa Of xs 9 
: Al 
OUR OU; Lis 1 OX; UK OU; * Dhar Uj 2 OXs OX; Ouk ents) 


To compute hy, 1, (Uo) from this formula, we evaluate the partial derivatives of x1, x2, 

., Xn at Uo and those of f at Xp = X(Uo). The formula is valid if x1, x2, ..., X, and 
their first partial derivatives are differentiable at Up and f, fi;, fro. ---, fx, and their first 
partial derivatives are differentiable at Xo. 

Instead of memorizing (5.4.18), you should understand how it is derived and use the 
method, rather than the formula, when calculating second partial derivatives of composite 
functions. The same method applies to the calculation of higher derivatives. 
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Example 5.4.5 Suppose that f and f, in Example 5.4.2 are differentiable on an open 
set S in R*. Differentiating (5.4.11) with respect to r yields 


ah a (af\. . 8 (af 
pz = 00s (5) + sino (2) 


(te a f as (Zt re) 
= cos 6 | —— — sin —+——=> 
dx? dr = Oy Ox Or dxdy dr dy” Or 


(5.4.19) 


if (x, y) € S. Since 
Ox 0 oF 0? f 


yo, 
—_— = 6, — = 6, d — 
or” x by dy dx 


if (x, y) € S (Exercise 5.3.21), (5.4.19) yields 
07h a? a f a? f 


ere : 3 
gp2 = 08 O52 ada eT: + sin Oye 


Differentiating (5.4.11) with respect to 6 yields 


2 
al a ae igo’! Rpg”. (=) + sino (=) 


00 ar ox oy 00 \ ox oy 
2 Lee of a? f ax a? f ay 
=-sindX + cos 02% + cos (TFT ew) 


PP Oe 8 fay 
me Ee 
ae ( 30 By? =) 


Since 4 4 
x ay _ 
aa > rsin@ and 50 rcos 6, 
it follows that 
07h 2 OF of i ane | 
ap dp = — sind. ene —rsin@cos 6 (3 _ a) 
2 
+r (cos? 6 — sin? got 
Oxdy 


The Mean Value Theorem 
For a composite function of the form 
h(t) = f(x1@), x2@),---, Xn @)) 


where ¢ is a real variable, x1, x2, ..., Xn are differentiable at fo, and f is differentiable at 
Xo = X(to), (5.4.8) takes the form 


h'(to) = D> fe; X(to)) x4; Wo). (5.4.20) 


J=1 


This will be useful in the proof of the following theorem. 
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Theorem 5.4.5 (Mean Value Theorem for Functions of n Variables) 
Let f be continuous at X, = (X11, X21,..-,Xn1) and X2 = (X12,%22,...,Xn2) and dif- 
ferentiable on the line segment L from X, to X2. Then 


n 
Sf (X2) — f(%1) = > Sx; %o) (%i2 — X11) = (dx f)(K2 — X1) (5.4.21) 
i=l 
for some Xo on L distinct from X, and Xp. 
Proof An equation of L is 
X= X(t) =tX.+(1-)X1, OK<t<1. 
Our hypotheses imply that the function 
A(t) = f(X()) 
is continuous on [0, 1] and differentiable on (0, 1). Since 
xi(t) = txj2 + I -1)xi, 
(5.4.20) implies that 
n 
W(Q) = DO fe KO) i2 — xi), <0 <1. 
i=l 
From the mean value theorem for functions of one variable (Theorem 2.3.11), 
h(1) —h(0) = h'(to) 


for some to € (0,1). Since h(1) = f(X2) and h(O) = f(X1), this implies (5.4.21) with 
Xo = X(to). 0 


Corollary 5.4.6 If fc,, fe,---, fx, are identically zero in an open region S of R", 
then f is constant in S. 


Proof We will show that if Xp and X are in S, then f(X) = f(Xo). Since S is an open 
region, S' is polygonally connected (Theorem 5.1.20). Therefore, there are points 


Xo, X1,...,X, =X 
such that the line segment L; from X;_; to X; is in S, 1 <i <n. From Theorem 5.4.5, 
n 
f&%) — fi) = DK — Xi-2), 
i=l 
where X is on L; and therefore in S. Therefore, 


fre; (Xi) = fro (Xi) =. = fry (Xi) = 0, 
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which means that dy. f = 0. Hence, 


f (Xo) = f(%1) = ++ = f(Kn); 
that is, f(X) = f(Xo) for every Xin S. aa) 


Higher Differentials and Taylor’s Theorem 


Suppose that f is defined in an n-ball B,(Xo), with p > 0. If X € Bp(Xo), then 
X(t) = Xo + ((K— Xo) € Byp(X), OK<t <1, 
so the function 
h(t) = f(X@) 
is defined for 0 < t < 1. From Theorem 5.4.3 (see also (5.4.20)), 


W'(t) = D> fe; (ai — xi0) 


i=1 


if f is differentiable in Bp(Xo), and 


"a (Safx) 
h(t) = > Axes (> ED) a — xXio) (x; _ xjo) 
j=1 J i=1 I 
= TO _ Xi0)(x; = x jo) 
. > Ox; OX; 
ij=l 
if for, feos +++» Sey are differentiable in Bp (Xo). Continuing in this way, we see that 
r n or 4 t)) 
eu = RO) (i, 1, 0) 081, 8,0) i, 0) (5.4.22) 
i1,i2,...ir=1 ip OXi,_} i 


if all partial derivatives of f of order < r — 1 are differentiable in B, (Xo). 


This motivates the following definition. 


Definition 5.4.7 Suppose that r > 1 and all partial derivatives of f of order < r —1 
are differentiable in a neighborhood of Xo. Then the rth differential of f at Xo, denoted 
by ak is defined by 


bd r 
(r) a” f (Xo) 
dy. f = a Bx Ounces Bag eit in ai» (5.4.23) 
i ids. ip=1 lr Ir-1 1 
where dx 1, dx2, ..., dXn are the differentials introduced in Section 5.3; that is, dx; is the 
function whose value at a point in R” is the ith coordinate of the point. For convenience, 
we define 


(dx) f) = f Xo). 
Notice that ie F = dx, f. a 
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Under the assumptions of Definition 5.4.7, the value of 
a” f (Xo) 
OXi, OXi,_4 erecs OXi, 
depends only on the number of times f is differentiated with respect to each variable, 


and not on the order in which the differentiations are performed (Exercise 5.3.22). Hence, 
Exercise 5.3.12 implies that (5.4.23) can be rewritten as 


(r) a= r! 0” f (Xo) r| TQ) we Tn 
dx f= X ryro!++ Pn! Ax4! OX5? +++ OXn” (dxi)" (dx2) (din), ea) 


where ee indicates summation over all ordered n-tuples (71, 72,...,7n) of nonnegative 
integers such that 

mt+rgate +m =r 
and ax; ‘ is omitted from the “denominators” of all terms in (5.4.24) for which r; = 0. In 
particular, ifn = 2, 


OxJ dy?—I 


i f= mi 5 0. ¥0) (4 ,y/ yf ‘(dy)’ ui, 


Example 5.4.6 Let 


1 
ae eT 
where a and bd are constants. Then 
a” f(x, y) =(- 1)’r ! ai bts 
Ox/ ayr—F (1 +ax + by)rtl’ 
so 
-1)"r! "fr\ , ; . ; 
i f= eons ot) Lc alb’~J (dx)i (dy) 
= TF ax + by d (') ee 
(-l)'r! 
Se (gg bdy)" 
(1 + axo + byo)’*! ROY) 


if 1 +axo + byo £0. 


Example 5.4.7 Let 
n 
f(X%) = exp —~\)ajx; ; 
j=l 
where dj, d2, ..., Gy, are constants. Then 


0” f(X) 


_ r . a; qn 
Beak? Bug 1) 41 a2 *°Ga OR Low 
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Therefore, 


rylrg!++-Tp! 


(dy? f)(®) = (-1)" (x si T= off a ess ta) 


r 


n 
x exp —} > a;x;0 
jal 
n 
= (—1)" (ay dx, + a2 dxy +++» + ay dxn)! exp | — » ajXj0 
jal 


(Exercise 5.3.12). a 


The next theorem is analogous to Taylor’s theorem for functions of one variable (Theo- 
rem 2.5.4). 


Theorem 5.4.8 (Taylor’s Theorem for Functions of n Variables) Suppose 
that f and its partial derivatives of order < k are differentiable at Xo and X in R” and on 
the line segment L connecting them. Then 


k 
1 1 
X) = ¥° - GP py«K-x Go FRX 5.4.25 
f(X) D7 1 + apie SK —Xo) (5.4.25) 
for some X on L distinct from Xo and X. 
Proof Define 
h(t) = f(®o + t(K — Xo)). (5.4.26) 
With ® = X — Xo, our assumptions and the discussion preceding Definition 5.4.7 imply 
that h, h’, ..., h&+ exist on [0, 1]. From Taylor’s theorem for functions of one variable, 
k 
h®”(0) h&+) (7) 
hd) = ——., 5.4.27 
(1) dX A Ge eared) 
for some t € (0, 1). From (5.4.26), 
h(O) = f(%o) and AC) = f(X). (5.4.28) 


From (5.4.22) and (5.4.23) with ® = X — Xo, 


h(0) = dQ f)\(K-Xo), ler <k, (5.4.29) 
and 
n+ (x) = (EH f) (K — Xo) (5.4.30) 
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where 3 

X = Xo + t(X — Xo) 
is on L and distinct from Xo and X. Substituting (5.4.28), (5.4.29), and (5.4.30) into 
(5.4.27) yields (5.4.25). an] 


Example 5.4.8 Theorem 5.4.8 and the results of Example 5.4.6 with Xo = (0, 0) and 
® = (x, y) imply that if 1 + ax + by > 0, then 


1 
l+ax+by 


(ax + by)k+! 


k 
_ Aa ri ¢_yykt1__ MT ON 
= DG Oy tO pages 


r=0 


for some t € (0, 1). (Note that t depends on k as well as (x, y).) 


Example 5.4.9 Theorem 5.4.8 and the results of Example 5.4.7 with Xo = 0 and 
® = X imply that 


é A (yy 
exp — 0 ajx; =e (G11 + dax2 +++ + anXn)" 
= 7 
Fico ere + d2X2 +-0++ jar 
(k +0! 


n 
x exp | —T ya ; 
j=l 
for some t € (0, 1). a 
By analogy with the situation for functions of one variable, we define the kth Taylor 


polynomial of f about Xo by 


k 


1 
Te(X) = DY S(dxy) f)(K — Xo) 


r=0 


if the differentials exist; then (5.4.25) can be rewritten as 


1 (ae) p(X — Xo). 


$0) = TOO + Gay 


A Sufficient Condition for Relative Extreme Values 


The next theorem leads to a useful sufficient condition for local maxima and minima. It 
is related to Theorem 2.5.1. Strictly speaking, however, it is not a generalization of Theo- 
rem 2.5.1 (Exercise 5.4.18). 
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Theorem 5.4.9 Suppose that f and its partial derivatives of order < k —| are differ- 
entiable in a neighborhood N of a point Xo in R" and all kth-order partial derivatives of 
f are continuous at Xo. Then 


FOO = THO _ 9 (5.4.31) 
XX |X — Xo|* 


Proof If« > 0, there is a 6 > O such that Bs(Xo) C WN and all kth-order partial 
derivatives of f satisfy the inequality 


ake) A F (Ko) 


i. a 5.4.32 
ON OM 4 ON ON ON, 4 9 ORG . 5(Xo) ( ) 


Now suppose that X € Bs(Xo). From Theorem 5.4.8 with k replaced by k — 1, 
1 
f(X) = Th) + GG? F(X ~ Xo), (5.4.33) 


where X is some point on the line segment from Xo to X and is therefore in Bs (Xo). We 
can rewrite (5.4.33) as 


FO) = Te) + [AP AK Xo) - UO AK-Xy]. 434 
But (5.4.23) and (5.4.32) imply that 
(dD? fx — Xo) — (dg? f)(K — Xo)| < n*e|X — Xol|* (5.4.35) 
(Exercise 5.4.17), which implies that 


| f(X) — T(X)| _ nke 


<—, Xe Bs(Xo), 
IX —Xolk ll 5(Xo) 
from (5.4.34). This implies (5.4.31). an 
Let r be a positive integer and Xo = (x10, X20,---, Xno). A function of the form 
PK) =) Gry rp..irm (1 — X10)" (2 — ¥20)"? +++ in — Xn0)”™, (5.4.36) 
r 


where the coefficients {a;,r...r,} are constants and the summation is over all n-tuples of 
nonnegative integers (71, 12,...,7,) such that 


ry Pie fsb, = 7, 


is a homogeneous polynomial of degree r in X — Xo, provided that at least one of the 
coefficients is nonzero. For example, if f satisfies the conditions of Definition 5.4.7, then 
the function 


p(X) = (dy? f)(X — Xo) 
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is such a polynomial if at least one of the rth-order mixed partial derivatives of f at Xo is 
nonzero. 


Clearly, p(Xo) = 0 if p is a homogeneous polynomial of degree r > 1 in X — Xo. 
If p(X) = 0 for all X, we say that p is positive semidefinite; if p(X) > 0 except when 
X = Xo, p is positive definite. 

Similarly, p is negative semidefinite if p(X) < 0 or negative definite if p(X) < 0 for all 
X # Xo. In all these cases, p is semidefinite. 


With p as in (5.4.36), 
p(—X + 2X0) = (-1)’ p(X), 


so p cannot be semidefinite if r is odd. 
Example 5.4.10 The polynomial 
P(x y DHxr+tyVtertxytuztyz 


is homogeneous of degree 2 in X = (x, y, z). We can rewrite p as 
1 
POY.) = 5 [(~+yP +42)? + +x)’], 


so p is nonnegative, and p(X, y, Z) = 0 if and only if 


X+yYHVrT=Z+xX=0, 


which is equivalent to (x,y,z) = (0,0,0). Therefore, p is positive definite and —p is 
negative definite. 


The polynomial 
Pi(x, y,Z) = x7 + y? +27 + xy 
can be rewritten as 
pilx, yz) = (x+y)? +27, 


sO pi iS nonnegative. Since pi(1,—1,0) = 0, pi is positive semidefinite and —p is 
negative semidefinite. 


The polynomial 
ROD =x Hy +e 


is not semidefinite, since, for example, 
p201,0,0)=1 and p2(0,1,0) = 1. | 
From Theorem 5.3.11, if f is differentiable and attains a local extreme value at Xo, then 
dx, f = 0, (5.4.37) 


since fx, (Xo) = fx. (Xo) =--- = fx, (Xo) = 0. However, the converse is false. The next 
theorem provides a method for deciding whether a point satisfying (5.4.37) is an extreme 
point. It is related to Theorem 2.5.3. 
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Theorem 5.4.10 Suppose that f satisfies the hypotheses of Theorem 5.4.9 withk > 
2, and 
a fso (lsr<k-1), dy f £0. (5.4.38) 


Then 


(a) Xo is not a local extreme point of f unless af is semidefinite as a polynomial in 
X — Xo. In particular, Xo is not a local extreme point of f ifk is odd. 


(b) Xo is a local minimum point of f ifdg f is positive definite, or a local maximum 
point ifdef is negative definite. 


(c) Wag f is semidefinite, then Xo may be a local extreme point of f, but it need not 
be. 


Proof From (5.4.38) and Theorem 5.4.9, 


1 
f(&) ~ f (Ko) — F (dx (XK — Xo) 
lim ——__+_W______ = 0. (5.4.39) 
X>Xo [X — Xo|* 


If X = Xp + tU, where U is a constant vector, then 
k k 
(dg? f)(K — Xo) = tas? f\U), 
so (5.4.39) implies that 


t* 
f(&o + WU) — fKo) — F(x) (YU) 
lim ——_——————— = 0, 
t>0 t 
or, equivalently, 
in f(Xo + 1U) — f(%o) _ 1 


(k) 
nn 7k 7 axy f)U) (5.4.40) 


for any constant vector U. 


To prove (a), suppose that dg? f is not semidefinite. Then there are vectors U; and U2 
such that 
(dy? f\U1) > 0 and (dy? f)(U2) < 0. 


This and (5.4.40) imply that 
f (Xo + 1Ui) > f(Xo) and f(Xo + tU2) < f(Xo) 


for t sufficiently small. Hence, Xo is not a local extreme point of f. 


To prove (b), first assume that ce f is positive definite. Then it can be shown that 
there is a p > 0 such that 


(dg? f \(X — Xo) 


7 > p|X — Xo|* (5.4.41) 
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for all X (Exercise 5.4.19). From (5.4.39), there is a 6 > O such that 
X) — f(Xo) — = pyx—x 
SR — f 0) — aC X) J)(X — Xo) 
|X — Xo|* 
Therefore, 
1 k p : 
f(&) — (Ko) > F (dx) (XK — Xo) — FIX—XolF if [X—Xo] <6. 
This and (5.4.41) imply that 
F(X) - f(%o) > SIX-Xol* if [X—Xol <8, 


which implies that Xo is a local minimum point of f. This proves half of (b). We leave 
the other half to you (Exercise 5.4.20). 


To prove (c) merely requires examples; see Exercise 5.4.21. q 


Corollary 5.4.11 Suppose that f, f., and fy are differentiable in a neigborhood of a 
critical point Xo = (Xo, yo) of f and fxx, fyy, and fy are continuous at (Xo, yo). Let 


D = frx(X0, Yo) fey (Xo, Yo) — fey (Xo, Yo)- 
Then 


(a) (xo, yo) is a local extreme point of f if D > 0; (xo, yo) is a local minimum point if 
Fixx (Xo, Yo) > 0, ora local maximum point if fxx (x0, Yo) < 0. 


(b) (xo, yo) is not a local extreme point of f if D <0. 
Proof Write (x — xo, y — yo) = (u, v) and 
p(u,v) = dQ fu, v) = Au? + 2Buv + Cv’, 
where A = fyx(X0, yo), B = fxy(Xo, Yo), and C = fyy(Xo, Yo), so 
D = AC - B?. 


If D > 0, then A ¥ 0, and we can write 


2B B? B2 
plu,v)=A (w? + —uv + =") ao (c — =) v? 


A A? 
B\? D 
=Alu+—v —y? 
(v4 3) +3 
This cannot vanish unless uv = v = 0. Hence, i f is positive definite if A > 0 or 


negative definite if A < 0, and Theorem 5.4.10(b) implies (a). 
If D < 0, there are three possibilities: 
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B D 
1. A £0; then p(1,0) = A and p (-5. i) ae 


B D 
2. C #0; then p(0, 1) = C and p (1.-2) _ a 


3. A=C =0; then B # Oand p(1, 1) = 2B and p(1,—1) = —2B. 


In each case the two given values of p differ in sign, so Xo is not a local extreme point 
of f, from Theorem 5.4.10(a). a 


Example 5.4.11 If 


f(x,y) = et thy? 
then 


Sc (%, y) = 2ax f(x, y), Sy(x, y) = 2by f(x, y), 


so 
fx (0,0) = fy, 0) = 0, 
and (0, 0) is a critical point of f. To apply Corollary 5.4.11, we calculate 
Fax(x, ¥) = (2a + 47x’) f(x, y), 
Syy(X, y) = (2b + 4b7y*) f(x, y), 
Say (x, y) = 4abxyf (x, y). 


Therefore, 
D = fxx(0,0) fyy(0, 0) — fe, (0,0) = (2a)(2b) — (0) 0) = 4ab. 
Corollary 5.4.11 implies that (0, 0) is a local minimum point if a and b are positive, a local 


maximum if a and b are negative, and neither if one is positive and the other is negative. 
Corollary 5.4.11 does not apply if a or D is zero. 


5.4 Exercises 


In the exercises on the use of the chain rule, assume that the functions satisfy appropriate 
differentiability conditions. 


1. Under the assumptions of Theorem 5.4.3, show that Uo is an interior point of the 
domain of h. 
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Let h(U) = f(G(U)) and find dy,h by Theorem 5.4.3, and then by writing h 
explicitly as a function of U. 


(a) f(x,y) = 3x? + 4xy? + 3x, 
gi(u,v) = vette-1, (uo, vo) = (0, 1) 


g2(u, v) _ e eter l 


(b) Gye) Seer, 
gi(u,v,w) = logu—logv + logw, 
go(u,v,w) = —2logu —3logw, 
g3(u,v,w) = logu+logu + 2logw, 


(c) fy) = @+y/, 
gi(u,v) = ucosnv, (uo, Vo) = (3, 2/2) 
go(u,v) = usin, 


(uo, Vo, wo) = d, 1, 1) 


(d) f(@,y,z) = x? +y? +27, 
gi(u,v,w) = ucosusinw, 
g2(u,v,w) = ucosucosw, 
g3(u,v,w) = usinv; 


(Uo, Vo, Wo) = (4, 2/3, 1/6) 


Let h(r, 0,z) = f(x, y,z), where x = rcos@ and y = rsin@. Find h,, hg, and 
hz interms of fy, fy, and fr. 
Let h(r, 0,6) = f(x, y,z), where x = rsingcosé, y = rsingsin#, and z = 
rcos @. Findh,, hg, and hg interms of f,, fy, and fz. 
Prove: 
(a) Ifh(u,v) = f(u? + v”), then vhy —uhy = 0. 
(b) Ifh(u,v) = f(sinu + cos v), then h, sinv +h, cosu = 0. 
(c) Ifh(u,v) = f(u/v), then uhy + vhy = 0. 
(d) Ifh(u,v) = f(g, v),—g(u, v)), then dh = (fe — fy) dg. 
Find hy and h; if 
ACY, Z) = (xy, 2), ¥,Z, Wy, Z)). 


Suppose that u, v, and f are defined on (—oo, co). Let u and v be differentiable 
and f be continuous for all x. Show that 


d v(x) 
re. f(t) dt = f(v(x))v'(x) — fu))u' (x). 
X Ju(x) 


We say that f = f (x1, X2,..., Xn) is homogeneous of degree r if Dy is open and 
there is a constant 7 such that 


Sf (tx1, tX2,...,tX%n) = t" f(%1, X2,...,Xn) 
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10. 


11. 


12. 


13. 


14. 


15. 


16. 


17. 


whenever t > 0 and (x1, X2,...,%n) and (tx1,¢x2,...,tx,) are in Dy. Prove: If 
f is differentiable and homogeneous of degree r, then 


n 
Ri ee) = rf (X1,X2,...,Xn). 


i=1 
(This is Euler’s theorem for homogeneous functions.) 
If h(r, 0) = f(rcos 6,r sin @), show that 


1 1 
fx + fyy = Mer + ahr oF “2 100- 


HINT: Rewrite the defining equationas f(x,y) = h(r(x, y), 0(x, y)), withr(x, y) = 
Vx2 + y?2 and 6(x, y) = tan!(y/x), and differentiate with respect to x and y. 
Let h(u, v) = f(a(u, v), b(u, v)), where a, = by and a, = —b,. Show that 


hun + ho» = fx + fyy)(a2 + 22). 


Prove: If 

u(x,t) = f(x —ct)+ g(x + ct), 
then u;7 = C7Uxx. 
Let h(u,v) = f(u+v,u—v). Show that 


1 
(a) fex— fyy =huy  (b) fax + Hy = 5 uw + hyv) 
Returning to Exercise 5.4.4, find h;, and h,g in terms of the partial derivatives of 
f. 


Let hy,» = 0 for all (u, v). Show that / is of the form 
h(u, v) = U(u) + V(v). 
Use this and Exercise 5.4.12(a) to show that if f:x — fyy = 0 forall (x, y), then 


S(x,y) =U(x + y) + V(x — y). 


Prove or give a counterexample: If f is differentiable and f, = 0 ina region D, 
then f(x1, y) = f(x2, y) whenever (x1, y) and (x2, y) are in D; that is f(x, y) 
depends only on y. 


Find 73(X). 

(a) f(x,y) =e* cosy, Xo = (0,0) 

(b) f(x,y) =e*, Xo = (0,0) 

(c) f@y2=@+y4+z-3), Xo=(11,1) 
(d) f(x, y,z) =sinxsinysinz, Xo = (0,0,0) 
Use Eqns. (5.4.23) and (5.4.32) to prove Eqn. (5.4.35). 


18. 
19. 


20. 
21. 


22. 


23. 


24. 
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Carefully explain why Theorem 5.4.9 is not a generalization of Theorem 2.5.1. 


Suppose that p is a homogeneous polynomial of degree r in Y and p(Y) > 0 for all 
nonzero Y in R”. Show that there is a p > 0 such that p(Y) > p|Y|” for all Y in 
IR”. HINT: p assumes a minimum on the set {Y | lY| = 1} . Use this to establish the 
inequality in Eqn. (5.4.41). 


Complete the proof of Theorem 5.4.10(b). 
(a) Show that (0, 0) is a critical point of each of the following functions, and that 
they have positive semidefinite second differentials at (0, 0). 
P(x, y) =x? — Ixy ty? 4x4 + y%; 
q(x, y) =x? — Ixy + y? —x4 — y4. 
(b) Show that D as defined in Corollary 5.4.11 is zero for both p and q. 
(c) Show that (0, 0) is a local minimum point of p but not a local extreme point 


of q. 
Suppose that p = p(x1,X2,...,Xn) is a homogeneous polynomial of degree r 
(Exercise 5.4.8). Let i1, i2, ..., in be nonnegative integers such that 
ip tigteotin=k, 
and let 


OF pior45 Xo, ix 25. Xp) 

Ox, xe =-<dxe" 
Show that g is homogeneous of degree < r — k, subject to the convention that a 
homogeneous polynomial of negative degree is identically zero. 


q(X1,X2,..-,Xn) = 


Suppose that f = f(x1,%X2,...,%n) is a homogeous function of degree r (Exer- 
cise 8), with mixed partial derivative of all orders. Show that 


n 
a? XQ, 0003 
> ip a) == r(r — 1) f (x1, X2,..., Xn) 
Par OX; OX; 
i,j=l 
and 
n 
O° (64s Xoyce 
> gp ee =r(r —1)(7 —2) f (x1, X2,..., Xn). 
Reo . OX; OX j OX 
i,j,k=1 
Can you generalize these results? 


Obtain the result in Example 5.4.7 by writing 
F(X) = e F1*1 9 42X2 ae e anxn 
formally multiplying the series 


CO Tr; 
- XxX; t 
a?) eyes, 12r25 
r;! 
rj=0 


together, and collecting the resulting products appropriately. 
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25. Let 
fier 


By writing 
Co 
@+y) 
fo.yy= ety 
r=0 . 


and expanding (x + y)” by means of the binomial theorem, verify that 


a) f= > (j)setperentan 


400) dxF Oy? 


CHAPTER 6 


Vector- Valued Functions 


of Several Variables 


IN THIS CHAPTER we study the differential calculus of vector-valued functions of several 
variables. 


SECTION 6.1 reviews matrices, determinants, and linear transformations, which are inte- 
gral parts of the differential calculus as presented here. 


SECTION 6.2 defines continuity and differentiability of vector-valued functions of several 
variables. The differential of a vector-valued function F is defined as a certain linear trans- 
formation. The matrix of this linear transformation is called the differential matrix of F, 
denoted by F’. The chain rule is extended to compositions of differentiable vector-valued 
functions. 


SECTION 6.3 presents a complete proof of the inverse function theorem. 


SECTION 6.4. uses the inverse function theorem to prove the implicit function theorem. 


6.1 LINEAR TRANSFORMATIONS AND MATRICES 


In this and subsequent sections it will often be convenient to write vectors vertically; thus, 


instead of X = (x1, X2,...,Xn) we will write 
XxX] 
x2 
X= : 
Xn 


when dealing with matrix operations. Although we assume that you have completed a 
course in linear algebra, we will review the pertinent matrix operations. 


We have defined vector-valued functions as ordered n-tuples of real-valued functions, in 
connection with composite functions h = f o G, where f is real-valued and G is vector- 
valued. We now consider vector-valued functions as objects of interest on their own. 
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If fi, fo,.--, fm are real-valued functions defined on a set D in R”, then 
fi 
hr 
F= : 
tm 
assigns to every X in D an m-vector 
fi (X) 
f2(X) 
F(X) = 
fm(X) 
Recall that fi, fo, ..-, fm are the component functions, or simply components, of F. We 
write 
F:R” > R” 


to indicate that the domain of F is in R” and the range of F is in R”. We also say that F is a 
transformation from R” to R™. If m = 1, we identify F with its single component function 
fi and regard it as a real-valued function. 


Example 6.1.1 The transformation F : R* — R? defined by 


has component functions 


Ai, y) = 2x+3y, folx,y)=—x+4y, fa(x,y)=x—-Yy. 


Linear Transformations 


The simplest interesting transformations from R” to R” are the linear transformations, 
defined as follows 


Definition 6.1.1 A transformation L : R” — R” defined on all of R” is linear if 
L(X + Y) = L(X) + L(y) 


for all X and Y in R” and 
L(aX) = aL(X) 


for all X in R” and real numbers a. 
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Theorem 6.1.2 A transformation L : R" — R” defined on all of R" is linear if and 
only if 
@11X1 + 412X2 F+++ + AinXn 


21X1 + A22X2 ++++ + A2nXn 
L(x) = : , (6.1.1) 


Ami X1 + Am2X2 + +++ + AmnXn 


where the aj; ’s are constants. 


Proof If can be seen by induction (Exercise 6.1.1) that if L is linear, then 


L(a,X, + a2X2 +--+ +a,X,) = ay L(X1) + a2L(X2) +---+ a,L (Xx) (6.1.2) 


for any vectors X;, Xo, ..., Xx and real numbers a), dz, ..., ax. Any X in R” can be 
written as 
bal 1 0 0 
x2 0 1 0 
X= = x1 . + x2 . tees t Xn 
Xn 0 0 1 


= x, KE, + x2Eo + ---+ x,E,. 
Applying (6.1.2) withk =n, X; = E;, and a; = x; yields 


L(X) = x, L(F)) + x2L(E2) + --- + x,L(E,). (6.1.3) 
Now denote 
aij 
aaj 
L({E;) = ; : 
aAmj 
so (6.1.3) becomes 
ai ai2 in 
a2} a22 a2n 
L(X) = x1 ‘ +x2| . fre + Xp 
aAm1 aAm2 Amn 


which is equivalent to (6.1.1). This proves that if L is linear, then L has the form (6.1.1). 
We leave the proof of the converse to you (Exercise 6.1.2). aa) 


We call the rectangular array 
411 412 "+ Gin 
421 421 *** 42n 
A= . 2 F . (6.1.4) 


Ami Gm2 *** Amn 
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the matrix of the linear transformation (6.1.1). The number a;; in the ith row and jth 
column of A is called the (i, 7 )th entry of A. We say that A is an m x n matrix, since A 
has m rows and n columns. We will sometimes abbreviate (6.1.4) as 


A = [aj;]. 


Example 6.1.2 The transformation F of Example 6.1.1 is linear. The matrix of F is 


2 3 
—1 4 |. a 
1 -l 


We will now recall the matrix operations that we need to study the differential calculus 
of transformations. 


Definition 6.1.3 

(a) Ifc isareal number and A = [a;;] is an m x n matrix, then cA is the m x n matrix 
defined by 

cA = [ca;;]; 

that is, cA is obtained by multiplying every entry of A by c. 

(b) If A = [aj] and B = [b;;] are m x n matrices, then the sum A + B is the m x n 
matrix 

A+B = [aj + bij); 

that is, the sum of two m x n matrices is obtained by adding corresponding entries. 
The sum of two matrices is not defined unless they have the same number of rows and 
the same number of columns. 

(c) If A = [aj] is an m x p matrix and B = [b;;] is a p x n matrix, then the product 
C = ABis the m x n matrix with 


P 
cij = Gi1b1j + ajzboj + +++ + dipbpj = Yo aikbej. l<i<m,1<j <n. 
k=1 


Thus, the (7, /)th entry of AB is obtained by multiplying each entry in the ith row of 
A by the corresponding entry in the 7th column of B and adding the products. This 
definition requires that A have the same number of columns as B has rows. Otherwise, 
AB is undefined. 


Example 6.1.3 Let 


2 0 1 1 
A=]|]-l1 03), B=] -l1 0 2 |, 
0 1 0 3 0 1 


and 
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Then 
2(2) 2(1) 2(2) 42 4 
2A=] 2(-1) 2(0) 2(3) |=] —2 0 6 
2(0) 2(1) 2(0) 0 2 0 
and 
2+0 141 241 2 2 3 
A+B=]| -1-1 04+0 34+2 |=) —2 0 5 
0+3 14+0 0O+1 3 1 #1 


The (2, 3) entry in the product AC is obtained by multiplying the entries of the second 
row of A by those of the third column of C and adding the products: thus, the (2, 3) entry 
of AC is 

(-1)(1) + @)(-3) + BH) = -4. 


The full product AC is 
2 IQ 5 0 1 2 15 0 -3 7 
-1 0 3 3 0 —-3 1}]=] —2 0 -4 1 
0 1 0 1 0 -1 1 3 0 -3 1 
Notice that A + C, B + C, CA, and CB are undefined. | 


We leave the proofs of next three theorems to you (Exercises 6.1.7—6.1.9) 


Theorem 6.1.4 /fA, B, and C are m x n matrices, then 


(A+B)+C=A+4+(B4+O). 


Theorem 6.1.5 JfA and B are m xn matrices andr and s are real numbers, then (a) 
r(sA) = (rs)A; (b) (r +5)A =rA+sA; (c) r(A+B) =rA+rB. 


Theorem 6.1.6 /f A, B, and C are m x p, p x q, and q Xn matrices, respectively, 
then (AB)C = A(BC). 


The next theorem shows why Definition 6.1.3 is appropriate. We leave the proof to you 
(Exercise 6.1.11). 


Theorem 6.1.7 


(a) Ifwe regard the vector 


as ann X | matrix, then the linear transformation (6.1.1) can be written as 


L(X) = AX. 
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(b) If Ly and Lz are linear transformations from R" to R™ with matrices A, and Az 
respectively, then c,Ly + C22 is the linear transformation from R”" to R™ with 
matrix c;A, + c2A2. 


(c) TfL, : RR” > R? and Lz : R? — R” are linear transformations with matrices A, 
and Ago, respectively, then the composite function L3 = Lz o Ly, defined by 


L3(X) = Lo(L1(X)), 


is the linear transformation from R” to R™ with matrix A2A4. 


Example 6.1.4 If 


2x + 3y —x-y 
L,(X) = 3x + 2y and Lo(X)=] 4x+y |, 
—x+ y x 
then 
2; 3 -l - 
A, = 3 2 and A» = 4 1 
-1 1 1 0 
The linear transformation 
L=2L;+12 
is defined by 
L(X) = 2L1(X) + L2(X) 
2x + 3y —x-y 
=2/ 3x+2y [+] 4x+y 
—x+ y x 
3x + 5y 
=| 10x+5y 
—x + 2y 
The matrix of L is 
3 5 
A= 10 5 | = 2A; + Ad. 
-1 2 


Example 6.1.5 Let 


_| *+2y |. p2 2 
nie@o=| 252 |e — R?, 
and 
u+ v 
L2(U) =| —u—2v | :R? > R?. 


3u+ v 
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Then L3 = Lz o L, : R* > R? is given by 
(x+2y)+ (3x + 4y) 4x+ 6y 
L3(X) = Lo((Li (KX) = | —(*# + 2y¥) —2(3x+4y) | =|] —-7x-10y 
3(x +2y)+ (Gx + 4y) 6x + 10y 
The matrices of L; and L2 are 
1 1 
Ay = ba and Ad = —-l -2 7 
3 4 
1 
respectively. The matrix of L3 is 
4 6 
C=] —7 —-10 | = AdA). 
6 10 
Example 6.1.6 The linear transformations of Example 6.1.5 can be written as 
1 1 
1 2 x u 
no=|3 4 ][ 5] we@=| -1 2 | 8]. 
3 1 
and 
4 6 z 
L3(X) =| —7 —10 . 
6 10 |b” 
A New Notation for the Differential 
If a real-valued function f : R” — R is differentiable at Xo, then 
dxo f = fx, Ko) dx1 + faxz (Xo) dx2 + +++ + fen (Xo) dxn. 
This can be written as a matrix product 
ax, 
dx2 
dxyf = [fx (Ko0)  feo(Ko) +++ fx, (Xo)] : . (6.1.5) 
aXn 
We define the differential matrix of f at Xo by 
f'(Xo) = [for (Xo) fx> (Xo) + fry %o)] (6.1.6) 
and the differential linear transformation by 
dx, 
dx2 


dX = 


aXn 
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Then (6.1.5) can be rewritten as 
dx, f = f'(Xo) dX. (6.1.7) 


This is analogous to the corresponding formula for functions of one variable (Exam- 
ple 5.3.7), and shows that the differential matrix f’(Xo) is a natural generalization of the 
derivative. With this new notation we can express the defining property of the differential 
in a way similar to the form that applies for n = 1: 


km LOO = Ko) — f'(Ko)(K = Xo) _ 
mM 


0, 
X>Xo |X — Xo| 


where Xo = (X10, X20,---,Xno) and f’(Xo)(X — Xo) is the matrix product 


X1 — X10 

X2 — X20 
[ fx, (Xo) Sixx (Xo) = Fon Xo) 

Xn — Xn0 


As before, we omit the Xo in (6.1.6) and (6.1.7) when it is not necessary to emphasize 
the specific point; thus, we write 


y= ta foo oct Fuel and df = f’dX. 
Example 6.1.7 If 
9,2) =A py , 
then 
f' sy.) = (Bxyz* 4x2z* 12x? yz). 
In particular, if Xo = (1, —1, 2), then 
f'(Xo) =[-64 32 —48], 
SO 


dx 

dx, f = f'(Xo)dX =[-64 32 —48]] dy 
dz 

= —64dx + 32dy — 48 dz. 


The Norm of a Matrix 
We will need the following definition in the next section. 


Definition 6.1.8 The norm, ||A||, of an m x n matrix A = [a;;] is the smallest number 
such that 
|AX] < ||A] [X| 


for all X in R”. | 
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To justify this definition, we must show that ||A|| exists. The components of Y = AX 
are 
Vi = Gi1X1 + Aj2X2 +++++QinXn, LSix<m. 


By Schwarz’s inequality, 
Ye S Gh t+ Gig +++ + ai XP. 
Summing this over | <i < m yields 


n 


m 
vi? <| > S242, | xp. 


i=1j/=1 
Therefore, the set 
B = {K||AX| < K|X| forall X inR”} 


is nonempty. Since B is bounded below by zero, B has an infimum q@. If € > 0, then a + € 
is in B because if not, then no number less than w + € could be in B. Then aw + € would be 
a lower bound for B, contradicting the definition of a. Hence, 


|AX| < (a +.)|X|], XeR’. 
Since € is an arbitrary positive number, this implies that 
|AX| <a@|X|, XeR", 


soa € B. Since no smaller number is in B, we conclude that ||A|| = a. 


In our applications we will not have to actually compute the norm of a matrix A; rather, 
it will be sufficient to know that the norm exists (finite). 


Square Matrices 


Linear transformations from R” to R” will be important when we discuss the inverse func- 
tion theorem in Section 6.3 and change of variables in multiple integrals in Section 7.3. 
The matrix of such a transformation is square; that is, it has the same number of rows and 
columns. 


We assume that you know the definition of the determinant 


aii 412 *** Gin 
a21 422 ‘++ 42n 
det(A) = 
Qni Gn2 °*** Ann 
of ann Xn matrix 
411 412 *** Gin 
421 422 °**: a2n 
A= 


Gn1 Gn2 *** Ann 
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The transpose, A‘, of a matrix A (square or not) is the matrix obtained by interchanging 
the rows and columns of A; thus, if 


1 2 3 1 3 
A=] 3 1 4], thn A’=]| 2 1 1 
Oo 1 -2 ee 


A square matrix and its transpose have the same determinant; thus, 
det(A’) = det(A). 
We take the next theorem from linear algebra as given. 


Theorem 6.1.9 /fA andB aren xn matrices, then 
det(AB) = det(A) det(B). 


The entries a;;, 1 <i <n, of ann xn matrix A are on the main diagonal of A. Then xn 
matrix with ones on the main diagonal and zeros elsewhere is called the identity matrix and 
is denoted by I; thus, ifn = 3, 


1 0 0 
I=; 0 1 0 
0 0 1 


We call I the identity matrix because AI = A and IA = A if A is any n x n matrix. We 
say that ann x n matrix A is nonsingular if there is ann x n matrix A~!, the inverse of A, 
such that AA~! = A~!A = I. Otherwise, we say that A is singular 

Our main objective is to show that an n x n matrix A is nonsingular if and only if 
det(A) 4 0. We will also find a formula for the inverse. 


Definition 6.1.10 Let A = [a;;] be ann x n matrix, with n > 2. The cofactor of an 
entry aj; is a 

cij = (-D!* det(Ais), 
where A;; is the (n — 1) x (m — 1) matrix obtained by deleting the 7th row and jth column 
of A. The adjoint of A, denoted by adj(A), is the n x n matrix whose (i, /)th entry is c;;. 


Example 6.1.8 The cofactors of 
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are 
-1 2 3 2 3  -1 
c= 1 > | =-4 CI 16 9, |= On la Fe I 3, 
1 4 1 4 2 
cn =—| 1 2 = -3. C22 = 0 2 = 8, C23 - 1 —4, 
1 4 1 4 2 
cn =| 1 2|- De SRS Sy: ge aD 3 i ay Ls 
so 
—4 -3 
adj((A)=] -6 8 -5 
3 -4 —-10 
Notice that adj(A) is the transpose of the matrix 
—4 -6 3 
—3 8 -4 
5 -—5 -—10 
obtained by replacing each entry of A by its cofactor. | 


For a proof of the following theorem, see any elementary linear algebra text. 


Theorem 6.1.11 Let A be ann xn matrix. 


(a) 


(b) 


The sum of the products of the entries of a row of A and their cofactors equals det(A), 
while the sum of the products of the entries of a row of A and the cofactors of the 
entries of a different row equals zero; that is, 


n 
det(A), 
Yo aie jk = ie ( ) 


k=1 


i= j, 
: : 6.1.8 
oe (6.1.8) 
The sum of the products of the entries of a column of A and their cofactors equals 
det(A), while the sum of the products of the entries of a column of A and the cofactors 
of the entries of a different column equals zero; that is, 
” det(A), i = j 
Yo ceidks = i ’ Sh 4 
k=1 ; 


sky (6.1.9) 


If we compute det(A) from the formula 


n 
det(A) = Y aincix, 
k=1 
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we Say that we are expanding the determinant in cofactors of its ith row. Since we can 
choose i arbitrarily from {1,...,7}, there are n ways to do this. If we compute det(A) 
from the formula 


n 
det(A) = S° agjck;. 
k=1 


we say that we are expanding the determinant in cofactors of its j th column. There are also 
n ways to do this. 


In particular, we note that det(I) = 1 foralln > 1. 


Theorem 6.1.12 Let A be ann x n matrix. If det(A) = 0, then A is singular. If 
det(A) 4 0, then A is nonsingular, and A has the unique inverse 


1 
Al= Sua) i). (6.1.10) 


Proof If det(A) = 0, then det(AB) = 0 for any n x n matrix, by Theorem 6.1.9. 
Therefore, since det(I) = 1, there is no matrix n x n matrix B such that AB = J; that is, A 
is singular if det(A) = 0. Now suppose that det(A) 4 0. Since (6.1.8) implies that 


Aadj(A) = det(A)I 


and (6.1.9) implies that 

adj(A)A = det(A)I, 
dividing both sides of these two equations by det(A) shows that if A~! is as defined in 
(6.1.10), then AA~! = A7!A =I. Therefore, A7! is an inverse of A. To see that it is the 


only inverse, suppose that B is ann x n matrix such that AB = I. Then A~!(AB) = A“!, 
so (A~!A)B = A7!. Since AA~! = I and IB = B, it follows that B = A~!. an] 


Example 6.1.9 In Example 6.1.8 we found that the adjoint of 


4 2 1 
A=] 3 -l1 2 
0 1 2 
is 
—-4 -3 5 
adj(A) = | —6 8 —5 
3 -4 -10 


We can compute det(A) by finding any diagonal entry of Aadj(A). (Why?) This yields 
det(A) = —25. (Verify.) Therefore, 


4-3 5 
Al=-—| -6 8 -5 |. = 
3 -4 -10 
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Now consider the equation 


AX =Y (6.1.11) 
with 
ai, a2 din x1 1 
a2, a22 a2n X2 y2 
A= : a, , and Y= 
Qni Gn2 °*** Ann Xn Yn 


Here A and Y are given, and the problem is to find X. 


Theorem 6.1.13 The system (6.1.11) has a solution X for any given Y if and only if 
A is nonsingular. In this case, the solution is unique and is given by X = A7'Y. 


Proof Suppose that A is nonsingular, and let X = A~!Y. Then 
AX = A(A71Y) = (AA71)Y = IY =; 


that is, X is a solution of (6.1.11). To see that X is the only solution of (6.1.11), suppose 
that AX; = Y. Then AX; = AX, so 


A7!(AX) = A7!(AX)) 


and 
(A71A)X = (A7!A)X), 


which is equivalent to IX = IX;, or X = Xj. 


Conversely, suppose that (6.1.11) has a solution for every Y, and let X; satisfy AX; = 
E;, 1 <i <n. Let 
B = [Xi Xz --- Xn}; 


that is, X;, Xo,..., X, are the columns of B. Then 
AB = [AX, AX> --- AX, ] = [E, Ep --- E,] = 1. 


To show that B = A7!, we must still show that BA = I. We first note that, since AB = I 
and det(BA) = det(AB) = 1 (Theorem 6.1.9), BA is nonsingular (Theorem 6.1.12). Now 
note that 

(BA)(BA) = B(AB)A) = BIA; 


that is, 
(BA)(BA) = (BA). 
Multiplying both sides of this equation on the left by BA)~! yields BA = I. q 


The following theorem gives a useful formula for the components of the solution of 
(6.1.11). 
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Theorem 6.1.14 (Cramer’s Rule) /f A = [aj;] is nonsingular, then the solu- 
tion of the system 


Q11X1 + 412X2 +--+ + 4inXn = V1 


1X1 + d22X2 + +--+ d2nXn = y2 


Ani X1 + An2X2 +°++ + annXn = Yn 


(or, in matrix form, AX = Y) is given by 


D; 
xi = ; 
det(A) 


1l<i<n, 


where Dj is the determinant of the matrix obtained by replacing the ith column of A with 
Y; thus, 


Yi 412 ++ Ain 411 Yi 413 *** Ain 
v2 (a22 «.-- 2n 421 yY2 423 **: 42n 
Di=| . a . | Doa= : . ; 
Yn Qn2 *** nn Qni1 Yn 4n3 *** Ann 
aii *** Qtn-1 V1 
a21 *** Q2n-1 y2 
Dy, = . 
Ani *** QAnyn-1 Yn 


Proof From Theorems 6.1.12 and 6.1.13, the solution of AX = Y is 


x1 Cir Car tts Cnt 1 

X2 4 1 C12 C22," Cn2 y2 
det(A) 

Xn Cin Can ‘** Cnn Yn 


C111 + C212 +++ + Cnt Yn 
C121 + C222 +++ + Cn2Yn 


Ciny1 + Cany2 +++ + Canyn 


But 
Yi 412 *** Gin 


v2 22. .-- G2n 
C11y1 + C212 Fee + Cri yn = 


Yn Gn2 *** 4nn 
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as can be seen by expanding the determinant on the right in cofactors of its first column. 


Similarly, 
411 Yi 413 +7: Gin 
421 Y2 423 **: 42n 
C121 + C222 +++ + Cn2Yn = ; ; ; ; 
Qni Yn 4n3  *** Ann 


as can be seen by expanding the determinant on the right in cofactors of its second column. 


Continuing in this way completes the proof. 


Example 6.1.10 The matrix of the system 


4x+2y+z=1 


3x -—y+2z=2 
y+2z=0 
is 
4 2 1 
A=|]3 -l 2 
0 41 2 
Expanding det(A) in cofactors of its first row yields 
-1 2 3 2 3 -1 
sacay =a]! 2] 2] 3 2 Jar | 
= 4(—4) — 2(6) + 1(33) = —25. 
Using Cramer’s rule to solve the system yields 
1 1 2 1 ) 1 4 1 1 ) 
x=-—/2 -1 2/=+, y=-—/3 2 2/=-2, 
216% as gl’ = 20) Or 2 ? 
ie oo) 
Z=-nx = =>. 
25 0 1.0 5 


A system of n equations in 1 unknowns 


G11X1 + 442X2 ++++ + inXn = 0 
d21X1 + A22X2 +++: + d2nXn =0 


Ani X1 + An2X2 +++++ annXn = 0 


aa 


(6.1.12) 


(or, in matrix form, AX = 0) is homogeneous. It is obvious that Xo = 0 satisfies this 
system. We call this the trivial solution of (6.1.12). Any other solutions of (6.1.12), if they 


exist, are nontrivial. 
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We will need the following theorems. The proofs may be found in any linear algebra 
text. 


Theorem 6.1.15 The homogeneous system (6.1.12) of n equations inn unknowns has 
a nontrivial solution if and only if det(A) = 0. 


Theorem 6.1.16 /f A,, Az,..., Ax are nonsingularnxn matrices, then so is Ay Az +++ Ax, 
and 


(AjAge Ap = AP A 47 


6.1 Exercises 


1. Prove: If LL: R” — R” is a linear transformation, then 
L(aiX1 + a2X2 + +++ + agXx) = ay L(X1) + ah (Xa) +--+ + ag Lh (Xx) 
if X,, Xo,..., X, are in R” and aj, az, ..., ag are real numbers. 
2. Prove that the transformation L defined by Eqn. (6.1.1) is linear. 
3. Find the matrix of L. 


3x + 4y + 6z ai Les, 
(a) L(X) =| 2x —4742z (b) LX) =| 21“? 
7x +2y + 3z bari, 
; 6x1; + X2 
4. FindcA. 
22 4 6 1 3 0 
(a)c=4,A=|001 3 (b)c=-2,A=]0 1 2 
3 4 7 II 1 -1 3 
5. FindA+B 
_ 2 3 —l 0 3 
(a)A=] 1 1 B=| 5 6 -7 
_ 0 -!l 2 
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Prove Theorem 6.1.4. 

Prove Theorem 6.1.5. 

Prove Theorem 6.1.6. 

Suppose that A + B and AB are both defined. What can be said about A and B? 
Prove Theorem 6.1.7. 

Find the matrix of aL; + bL2. 


3x +2y+ Zz 
(a) Li@,y,.zv=| x+4y+2z |, 
3x-—4y+4+ 2z 
—x+y- z 
Li(x,y,z)= | -—2x+y+3z |], a=2, b=-1 
y+ z 
2x + 3y 3x-—y 
(b) Li@x,y)=| x- y |, In@y)=| x+y |, a=4, d= 
4x+ y —-x-y 


Find the matrices of L,oL»2 and L2oL 1, where L; and L2 are as in Exercise 6.1.12(a). 
Write the transformations of Exercise 6.1.12 in the form L(X) = AX. 

Find f’ and f’(Xo). 

(a) f(x, y,z) =3x?yz, Xo =(1,-1,1) 

(b) f(x,y) =sin(x + y), Xo = (1/4, 2/4) 

(c) f(x,y,z)=xye%, Xo = (1,2, 0) 

(d) f(x, y,z) =tan(x +2y+2z), Xo = (2/4, —-7/8, 7/4) 

(e) f(X) =[X|:R°>R, Xo = (1/Vn,1/Vn,..., 1/2) 


Let A = [a;;] be an m Xx n matrix and 
A = max {lajj||1 <i <m,1<i<n}. 


Show that ||A|| < A./mn. 

Prove: If A has at least one nonzero entry, then ||A|| 4 0. 
Prove: ||A + B|| < [|All + ||BI. 

Prove: ||AB|| < ||Al| ||Bl. 

Solve by Cramer’s rule. 


X+ yt2z= 1 X+ y- Z= 5 
(a) 2x- y+ z=-l (b) 3x-2y+2z= 0 
x—2y—3z= 2 4x+2y—3z=14 
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gtdy hoe 5 xXx-— y+ z-2w= 1 


= 2x+ y—3z+3w= 4 
(c) 2 i) (d) 3x + 2y + w=13 
ae x+ y- z = 4 
21. Find A~! by the method of Theorem 6.1.12. 
2 3 
(a) | ; =| (b)| 10 -1 
1 2 
4 2 1 10 1 
(c)| 3 -1 2 (d)} 0 1 1 
0 1 2 1 1 0 
12 00 1 1 2 -1 
—22 3 0 0 22 -l 3 
()) 00 23 (@)} 14 1 2 
0 0 -1 2 3 1 0 1 
22. For! < i,j < m, let aj; = ajj(X) be a real-valued function continuous on a 


compact set K in R”. Suppose that the m x m matrix 
A(X) = [aij (X)] 
is nonsingular for each X in K, and define the m x m matrix 
B(X, Y) = [b;;(X, Y)] 


by 
B(X, Y) = A71(X)A(Y) -L. 


Show that for each € > 0 there is a 6 > 0 such that 
|bif(X.V)]<¢, 1 <i,j sm, 
if X,Y € K and |X — Y| < 6. HINT: Show that b;; is continuous on the set 
{(X, ¥) |X e K, Ye K}. 
Then assume that the conclusion is false and use Exercise 5.1.32 to obtain a contradiction. 


6.2 CONTINUITY AND DIFFERENTIABILITY OF TRANS- 
FORMATIONS 


Throughout the rest of this chapter, transformations F and points X should be considered as 
written in vertical form when they occur in connection with matrix operations. However, 
we will write X = (x1, X2,...,Xn) when X is the argument of a function. 
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Continuous Transformations 


In Section 5.2 we defined a vector-valued function (transformation) to be continuous at Xo 
if each of its component functions is continuous at Xo. We leave it to you to show that this 
implies the following theorem (Exercise 1). 


Theorem 6.2.1 Suppose that Xo is in, and a limit point of, the domain of F : R" > 
R™. Then F is continuous at Xo if and only if for each € > 0 there is a 6 > 0 such that 


|F(X) —F(Xo)| <e if |X—Xo| <6 and Xe Dy. (6.2.1) 


This theorem is the same as Theorem 5.2.7 except that the “absolute value” in (6.2.1) 
now stands for distance in R” rather than R. 


If C is a constant vector, then “limx-,x, F(X) = C” means that 
lim |F(X) —C| = 0. 
X—Xo 
Theorem 6.2.1 implies that F is continuous at Xo if and only if 


lim F(X) = F(Xo). 


Example 6.2.1 The linear transformation 


X+ yz 
L(X) = 2x -—3y +z 
2x+ y-Z 


is continuous at every Xo in R3, since 


(x —x0) + (y—yo) + & —Zo) 
L(X) — L(Xo) = L(X — Xo) = | 2(« — x0) —3(y — yo) + Z —Zo) |, 
2(x —x0) + (y — yo) — @ —Zo) 


and applying Schwarz’s inequality to each component yields 
|L(X) — L(Xo)|? < G + 14 + 6)[K — Xol? = 23|K — Xol?. 
Therefore, 
€ 


L(X) — L(Xo9)| <e if [X—Xo| < 
|L(X) — L(Xo)| | o| Ta 


Differentiable Transformations 


In Section 5.4 we defined a vector-valued function (transformation) to be differentiable at 
Xo if each of its components is differentiable at Xo (Definition 5.4.1). The next theorem 
characterizes this property in a useful way. 
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Theorem 6.2.2 A transformation F = (fi, fo,..-, fm) defined in a neighborhood of 
Xo € R” is differentiable at Xo if and only if there is a constant m x n matrix A such that 


F(X) — F(Xo) — A(X — Xo) _ 


lim 0. (6.2.2) 
X>Xo [X = Xo| 
If (6.2.2) holds, then A is given uniquely by 
dfi(Xo) afi(Xo) Afi (Ko) 
0X4 0x2 OXn 
Of2(Xo0)  If2(Xo) Of2(Xo) 
afi(X ie, 1h eee 
A= ES =) aa Oxp a (6.2.3) 
Ox; 4 ; . P 
Ofm (Xo) Ofm (Xo) —_ Ofm (Xo) 
Ox 0x2 OXn 
Proof Let Xo = (X10, X20,-..,Xno). If F is differentiable at Xo, then so are fi, fo, 
...) fm (Definition 5.4.1). Hence, 
". Of (X 
fi) - fi&o)- >> a D(x; — xj0) 
. a ; 
kim A —_—— = 0, 1 <i xm, 
X>Xo [X — Xo| 


which implies (6.2.2) with A as in (6.2.3). 


Now suppose that (6.2.2) holds with A = [a;;]. Since each component of the vector in 
(6.2.2) approaches zero as X approaches Xo, it follows that 


n 
F(X) — fi(Xo) — ) aij (xj — xj0) 
—— rr a er | 
x—Xo [X — Xo| 


so each fj is differentiable at Xo, and therefore so is F (Definition 5.4.1). By Theo- 
rem 5.3.6, 

_ Ofi (Xo) 
Ox; 
which implies (6.2.3). aa] 


A transformation T : R” — R” of the form 


, <ix<m, |l<j <n, 


aij 


T(X) =U+ A(X— Xo), 


where U is a constant vector in R”, Xo is a constant vector in R”, and A is a constant m xn 
matrix, is said to be affine. Theorem 6.2.2 says that if F is differentiable at Xo, then F can 
be well approximated by an affine transformation. 
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Example 6.2.2 The components of the transformation 
x* + 2xy +z 
F(X) =] x +2xz+y 
x? + y? + 2? 


are differentiable at Xo = (1,0, 2). Evaluating the partial derivatives of the components 
there yields 


22 1 
A=] 5 1 2 
2 0 4 
(Verify). Therefore, Theorem 6.2.2 implies that the affine transformation 


T(X) = F(Xo) + A(X — Xo) 


3 7 ae x-1 
aa eo es ee y 
5 20 4 z—-2 


satisfies 
F(X) —T(X) | 


im = 
X>Xo |X—Xo| 


Differential of a Transformation 


If F = (fi, fo...., fm) is differentiable at Xo, we define the differential of F at Xo to be 
the linear transformation 


dxy fi 
xy f: 
oe (6.2.4) 
dxy Tn 
We call the matrix A in (6.2.3) the differential matrix of F at Xo and denote it by F’ (Xo); 
thus, 
Ofi(Xo) Afi(Xo) Afi (Ko) 
Ox, 0x2 OXn 
Of2(Xo) Af2(Xo0) A f2(Xo) 
F’(Xo) = am ax On (6.2.5) 
Ofm(Xo) Afm(Xo) fm (Xo) 


Ox 0x2 OXn 
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(It is important to bear in mind that while F is a function from R” to R”, F’ is not such 
a function; F’ is an m x n matrix.) From Theorem 6.2.2, the differential can be written in 
terms of the differential matrix as 


dy,F =F(Xo)| (6.2.6) 


or, more succinctly, as 
dx, F = F’(Xo) dX, 


where 
dx 1 


dx2 
dX = 


aXn 
as defined earlier. 


When it is not necessary to emphasize the particular point Xo, we write (6.2.4) as 


dfi 
af, 
aF=| 
dfn 
(6.2.5) as 
ah th af 
OX, 0x2 OXn 
Of, Of, ahs 
r= Ox, 0x2 OXn 
Ox, 0x2 OXn 
and (6.2.6) as 
dF =F dx. 


With the differential notation we can rewrite (6.2.2) as 


iim ~& — F(Xo) — F'(X0)(K — Xo) 
De TT 


0. 
X>Xo |X — Xo| 
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Example 6.2.3 The linear transformation 
Q41X1 + 12X2 +++ + ainXn 
21X11 + d22X2 +++: + danXn 
F(X) = 
Ami X1 + Am2X2 + +++ + AmnXn 
can be written as F(X) = AX, where A = [a;;]. Then 
F =A; 


that is, the differential matrix of a linear transformation is independent of X and is the 
matrix of the transformation. For example, the differential matrix of 


1 2 3 
ons) =| 5 1 | x2 


jee D223 
P= 2 104° 
If F(X) = X (the identity transformation), then F’ = I (the identity matrix). 


Example 6.2.4 The transformation 


x 
G39) =) = 
x2 4 y2 

2xy 


is differentiable at every point of R* except (0, 0), and 


5 eee gs 2xy 
GP+y*7P (x? + y?)? 
F(x, y) = 2xy Sie 
(+ y*)? GPA + y*)? 
2y 2x 
In particular, 
0 —L 
2 
_ 1 
F'(1, 1) = ~ FZ 0 ’ 
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so 
1 1 
2 0-5 
: x-—1 
in ————— F(x, y)- |] 1 |-| -} 0 
(yy 70.) V(x — 1)? + (y — 1)? (*.y) 2 2 yo 
2 2 2 
0 
= 0 P| 
0 


If m = n, the differential matrix is square and its determinant is called the Jacobian of 
F. The standard notation for this determinant is 


afi aft afi 
dxr 9x2 Nn 
af af afr 
(fi. fas---,fn) _ | Ox, Axe OXn 
O(X1, X2,.--,Xn) 7 . : : 
Ofn fn Ofn 
OX, OXx2 oad OXn 


We will often write the Jacobian of F more simply as J(F), and its value at Xo as JF(Xo). 


Since ann x n matrix is nonsingular if and only if its determinant is nonzero, it follows 
that if F : R” — R" is differentiable at Xo, then F’(Xo) is nonsingular if and only if 
JF(Xo) 4 0. We will soon use this important fact. 


Example 6.2.5 If 


x? -IWx +z 
F(x,y,z)= | x+2xy+2z? |, 
X+y+Z 
then 
2x-2 O 1 
a] b 2 $ 

fi fo I) _ ppcxy = l4+2y 2x 2z 

0(X1, X2, X3) 1 1 1 
= 2x 2z 1+2y 2x 
=0x-2)| i | 1 1 


= (2x —2)(2x —2z) + (1 + 2y — 2x). 
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In particular, JF(1, —1, 1) = —3, so the differential matrix 
0 0 1 
F(,-1,1l)=] -1 2 2 
1 11 
is nonsingular. 


Properties of Differentiable Transformations 


We leave the proof of the following theorem to you (Exercise 6.2.16). 
Theorem 6.2.3 /fF : R” > R" is differentiable at Xo, then F is continuous at Xo. 
Theorem 5.3.10 and Definition 5.4.1 imply the following theorem. 


Theorem 6.2.4 Let F = (fi, fo,..., fm) : R” — R", and suppose that the partial 
derivatives 
af 


, L<i<m, 1<j<n, (6.2.7) 
Ox; 


exist on a neighborhood of Xo and are continuous at Xg. Then F is differentiable at Xo. 


We say that F is continuously differentiable on a set S if S is contained in an open set 
on which the partial derivatives in (6.2.7) are continuous. The next three lemmas give 
properties of continuously differentiable transformations that we will need later. 


Lemma 6.2.5 Suppose that F : R" — R” is continuously differentiable on a neigh- 
borhood N of Xo. Then, for every € > 0, there is a 6 > 0 such that 


|F(X) — F(Y)| < (IF’(Xo)|| +)|X—Y¥| if A,Y € Bs(Xo). (6.2.8) 
Proof Consider the auxiliary function 
G(X) = F(X) — F’(X)X. (6.2.9) 
The components of G are 


52 oes 


x re 


gi(X) = fi(X) — 


j=l 


so 


agi(X) _ afi(X) _ afi(Xo) 


Ox; Ox; Ox; 
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Thus, dg;/0x,; is continuous on N and zero at Xo. Therefore, there is a 5 > 0 such that 


dgi(X) € : 
< for 1L<i<m, 1l<j<n, if |X—Xo| <6. 6.2.10 
| ee Jai SES a | o| ( ) 
Now suppose that X, Y € Bs(Xo). By Theorem 5.4.5, 
n 
0g; (Xi) 
gi(X)—gi(¥) = >> — (xj — ys), (6.2.11) 
j=l " 


where X; is on the line segment from X to Y, so X; € Bs(Xo). From (6.2.10), (6.2.11), 
and Schwarz’s inequality, 


dgi(Xi) 
Ox; 


n 2 2 
(gi(X) — gi(¥))? < »| k-¥P < <px—-y¥P. 


f=) 
Summing this from i = 1 toi = m and taking square roots yields 

|G(X) — G(Y)| <e|K-—Y| if X,Y e€ Bs(Xo). (6.2.12) 
To complete the proof, we note that 

F(X) — F(Y) = G(X) — G(Y) + F’(Xo)(X — Y), (6.2.13) 
so (6.2.12) and the triangle inequality imply (6.2.8). 0 


Lemma 6.2.6 Suppose that F : R” — R" is continuously differentiable on a neigh- 
borhood of Xo and F' (Xo) is nonsingular. Let 


1 


r= ———_.. (6.2.14) 
|| (F’(Xo))" I 
Then, for every € > 0, there isa é > 0 such that 
|F(X) —F(Y)| > (r7-—©6€)|K-—Y| if X,Y € Bs(Xo). (6.2.15) 


Proof Let X and Y be arbitrary points in Dy and let G be as in (6.2.9). From (6.2.13), 


|F(X) — F(Y)| = ||F’(Xo0)(X — Y)| — |G(X) — G(Y)||, (6.2.16) 
Since 
X —Y = [F(Xo)]"'F’(Xo)(X — Y), 
(6.2.14) implies that 
1 

[X—Y|< ~|F'(Xo)(X =¥\, 
so 

|F’(Xo)(K — Y)| > r|K— Yj. (6.2.17) 


Now choose 6 > 0 so that (6.2.12) holds. Then (6.2.16) and (6.2.17) imply (6.2.15). an] 


See Exercise 6.2.19 for a stronger conclusion in the case where F is linear. 
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Lemma 6.2.7 [fF : R” > R” is continuously differentiable on an open set containing 
a compact set D, then there is a constant M such that 


|F(Y) — F(X)| < M|Y-X| if X,YeD. (6.2.18) 
Proof On 
S = {(X,¥Y)|X, Ye D} cR™” 
i IF(Y) — F(X) — F'(X)(¥ — X)| 
g(X, Y) = lY —X| jn 
Y=X. 


’ 


Then g is continuous for all (X, Y) in S such that X 4 Y. We now show that if Xo € D, 
then 


lim g(X, Y) = 0 = g(Xo, Xo): (6.2.19) 
(X,Y)>(X0,Xo) 


that is, g is also continuous at points (Xo, Xo) in S. 


Suppose that « > 0 and Xo € D. Since the partial derivatives of fi, fo, ..., fm are 
continuous on an open set containing D, there is a 6 > O such that 


afi(Y)  afi(X)| 


< 

Ox; Ox; /mn 
(Note that 0/;/dx; is uniformly continuous on Bs(Xo) for 6 sufficiently small, from The- 
orem 5.2.14.) Applying Theorem 5.4.5 to fi, fo,..., fm, we find that if X, Y € Bs (Xo), 
then 


if X,Y € Bs(Xo), 1<i<m,1<j <n. (6.2.20) 


fi) - fi® =) 


jJ=1 


(¥7 = Xj); 


“. Of; (Xi) 
Ox; 


where X; is on the line segment from X to Y. From this, 


2 2 
yy py WO), | POF) AFM], 
Ai) $00 - DP) -2) | = PB xO BO os -a) 

swolaf(®&) af(xXy7 
=|¥-X| »| Ox; ~ Ox; 


(by Schwarz’s inequality) 
ge 
<—|Y-X|?_ — (by (6.2.20)) 
m 
Summing fromi = | toi = m and taking square roots yields 
|F(Y) — F(X) — F'(X)(Y — X)| < e/Y—X| if X,Y © Bs(Xo). 


This implies (6.2.19) and completes the proof that g is continuous on S. 
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Since D is compact, so is S (Exercise 5.1.27). Therefore, g is bounded on S (Theo- 
rem 5.2.12); thus, for some M,, 


|F(Y) — F(X) — F'(X)(¥Y —X)| < Mi |X-Y| if X,YeD. 
But 


|F(Y) — F(X)| < |F(Y) — F(X) — F'(X)(¥ — X)| + |F’(X)(¥ — X)| 


<(M + |IF'(X)I)|(Y — XI. (6.2.21) 


Since 
1/2 


m on 9 : 2 
woo < (2 aN 
J 


i=1 j=1 
and the partial derivatives {0/; /0x ;} are bounded on D, it follows that ||F’(X)|| is bounded 
on D; that is, there is a constant M> such that 


|F(XO)|| <M, XeD. 
Now (6.2.21) implies (6.2.18) with M = M; + M). an 


The Chain Rule for Transformations 


By using differential matrices, we can write the chain rule for transformations in a form 
analogous to the form of the chain rule for real-valued functions of one variable (Theo- 
rem 2.3.5). 


Theorem 6.2.8 Suppose that F : R" — R"” is differentiable at Xo, G : R* — R” is 
differentiable at Up, and Xp = G(Ug). Then the composite functionH = FoG: RE > 
R”, defined by 

H(U) = F(G(U)), 


is differentiable at Uo. Moreover, 


H'(Uo) = F'(G(Uo))G’ (Up) (6.2.22) 
and 
dyyH = dx) F o dyG, (6.2.23) 
where o denotes composition. 
Proof The components of H are /1, h2,..., Am, where 


hi(U) = fi(GU)). 
Applying Theorem 5.4.3 to hj yields 


". Of (X 
dyghi = >" NO a9 l<i<m. (6.2.24) 
J 


J=1 
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Since 
dug hi dup 81 
dy, h2 dU 82 
dyu)H = ° and dy,G= : i 
dughm dU n 


the m equations in (6.2.24) can be written in matrix form as 


dy H = F’(Xo0)du)G = F’(G(Up)) du G. (6.2.25) 
But 
dy) G = G' (Up) du, 

where 

du, 

duz 

dU — + ’ 
dux 


so (6.2.25) can be rewritten as 
dy)H = F'(G(Uo))G! (Uo) dU. 


On the other hand, 
dy yH = H’(Up) dU. 


Comparing the last two equations yields (6.2.22). Since G’(Up) is the matrix of dy,G and 
F’(G(Uo)) = F’ (Xo) is the matrix of dx, F, Theorem 6.1.7(c) and (6.2.22) imply (6.2.23). 
O 


Example 6.2.6 Let Up = (1, —1), 


Ju 
x2 4 y? 4.22? 
G(U) = G(u,v) =} Vu2+3v2 |, F(X) = F(x, y,z) = ; . ; 
x" — y 
Vvu+2 


and 
H(U) = F(G(U)). 


Since G is differentiable at Up = (1, —1) and F is differentiable at 
Xo = G(Uo) = (1,2, 1), 


Theorem 6.2.8 implies that H is differentiable at (1, —1). To find H’(1, —1) from (6.2.22), 
we first find that 
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1 
—— 0 
2./u 
j u 3u 
G'(U) = ——————_ SS 
Juz +302 -/u2 + 3v2 
1 
0 Sea 
2/v+2 
and 
: — | 2x 2y 4z 
i 2x -2y 0 
Then, from (6.2.22), 
H’(1,-1) = F'(, 2, )G'(1, -1) 
1 
7 0 
_ | 2 4 4 1 Wea 3-4 
~| 2 -—4 0 2 2 ~ 1 =1 6 |° 
0 1 


We can check this by expressing H directly in terms of (uv, v) as 


(Vi? + (Viz F3u2) +2 (VOI)? 
(Vay? — (Vie FR?) 


H(u, v) = 


_ | wut+u? + 30242044 
= u —u? — 30? 


and differentiating to obtain 


7 —_ | 1+2u 6v+2 
won.) =| 3 60 |: 


which yields 
1 = 3 —4 
w-p=| | “al 


as we saw before. 


6.2 Exercises 


1. Show that the following definitions are equivalent. 


(a) F = (fi, fo,.-., fm) is continuous at Xo if fi, fo, ..., fm are continuous 


at Xo. 
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(b) F is continuous at Xo if for every « > 0 there is ad > 0 such that |F(X) — 
F(Xo)| < € if |X — Xo| < 6 and X € Dy. 


Verify that 
F(X) — F(Xo) — F’(XKo)(X — Xo) _ 


lim 0. 
X>Xo |X — Xo| 
3x + 4y 
(a) F(X)=] 2x- y |, Xo = (Xo, yo. Zo) 
x+ y 
Wxr+xy+1 
(b) F(X) = xy , Xo =(,-1) 
x2 4 y? 
sin(x + y) 
(c) F(X)=| sin(Qy+z) |, Xo = (2/4,0,7/4) 
sin(x + Z) 
Suppose that F : R”’ — R” and h : R” — R have the same domain and are 
continuous at Xo. Show that the product AF = (hf,, hfo,..., fm) is continuous at 


Xo. 


Suppose that F and G are transformations from R” to R” with common domain D. 
Show that if F and G are continuous at Xo € D, then so are F + G and F —G. 


Suppose that F : R” — R” is defined in a neighborhood of Xo and continuous at 
Xo, G : RX => R’" is defined ina neighborhood of Up and continuous at Up, and 
Xo = G(Up). Prove that the composite function H = F o G is continuous at Up. 


Prove: If F : R” — R” is continuous on a set S, then |F| is continuous on S. 


Prove: If F : R” — R” is continuous on a compact set S, then |F| is bounded on 
S, and there are points Xg and X; in S such that 


|F(Xo)| < |F(X)| < |F(X1)|, Xe S; 


that is, |F| attains its infimum and supremum on S. HINT: Use Exercise 6.2.6. 


Prove that a linear transformation L : R” — R” is continuous on R”. Do not use 
Theorem 6.2.8. 


Let A be anm Xn matrix. 
a) Use Exercises 6.2.7 and 6.2.8 to show that the quantitites 
(a) q 
|AX| 


M(A) = max | |x x of and m(A) = min 


|AX| 
|X| 


xzol 


exist. HINT: Consider the function L(Y) = AY on S = {Y | lY| = 1\ : 
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10. 


11. 


12. 


13. 


14. 


(b) Show that M(A) = ||Al. 
(c) Prove: If > morn = mand A is singular, then m(A) = 0. (This requires a 
result from linear algebra on the existence of nontrivial solutions of AX = 0.) 


(d) Prove: If = m and A is nonsingular, then 
m(A)M(A7!) = m(A7!)M(A) = 1. 


We say that F : R” — R” is uniformly continuous on S if each of its components 
is uniformly continuous on S. Prove: If F is uniformly continuous on S, then for 
each € > 0 there is a 5 > 0 such that 


IF(X)-F(Y)|<e« if |X-Y|<6é and X,YeS. 


Show that if F is continuous on R” and F(X + Y) = F(X) + F(Y) for all X and Y 
in R”, then A is linear. HINT: The rational numbers are dense in the reals. 


Find F’ and JF. Then find an affine transformation G such that 
F(X) —G(Y) _ 


li . 
XX xX — Xo 
x*>+y+42z 
(a) F(x,y,z) =] cosixt+y+z) |, Xo =(1,-1,0) 
eryve 
_ | e*cosy = 
(b) Fo =| SS"? |. xo = 0.272) 
x2—y? 
(c) F(x, y,z) = y? —2? , Xo = (1, 1,1) 
pee 
Find F’. 
81 (x) 
_| @w~+yt+z)e* _ 82(x) 
(a) Foy.d=[ OPES | wre =| ™ 
8n(X) 
e* sin yz 
(c) F(x, y,z) =| e* sinxz 
e* sinxy 
Find F’ and JF. 
Peasd rcos 6 cos b 
(a) F(r, 0) = (b) F(r,6,¢) =| rsin@cos¢ 
r sin@ ; 
rsing 
r cos 6 


(c) F(r,0,z) =] rsin@ 
z 


15. 


16. 
17. 


18. 


19. 


20. 
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Prove: If G; and G» are affine transformations and 


_ Gi(X) — Go(Y) 
lim —————— = 0, 
X—Xo [X = Xo| 


then G; = Go. 
Prove Theorem 6.2.3. 


Show that if F : R” — R” is differentiable at Xo and € > 0, there is ad > 0 such 
that 
|F(X) — F(Xo)| < (F’(Xo)|| + ©)|X—Xo] if |X—Xo| <6. 


Compare this with Lemma 6.2.5. 


Suppose that F : R” — R” is differentiable at Xo and F’ (Xo) is nonsingular. Let 


1 
"TIP Ko 


and suppose that « > 0. Show that there is a 6 > 0 such that 
|E(X) — F(Xo)| = (r —)|X—Xo] if [K—Xo| <6. 
Compare this with Lemma 6.2.6. 


Prove: If L : R” — R” is defined by L(X) = A(X), where A is nonsingular, then 
1 
IL) =L(¥)| = |x = ¥| 
|All 


for all X and Y in R”. 


Use Theorem 6.2.8 to find H’(Up), where H(U) = F(G(U). Check your results by 
expressing H directly in terms of U and differentiating. 


x2 4 y? w cos u Sinv 
(a) F(x, y,z) = Zz , Gtu,v,w) = wsinusinv |, Up = 
ale W COS U 
(1/2, 2/2, 2) 
x? —y? VCOS U 
(b) F(x,y) = y , Gtu,v) = . Us = (n/4,3) 
— v sinu 
x 
3x +4y +2z4+6 u—- v 
(c) Fix, y,z)=| 4x-2y+ z-1 |, Gtu,v)=] ut v |, 
—x+ y+ z-2 u—2v 


Up arbitrary 
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(d) Fo =| 27? |, Gow) =| ae" |, Uo = Ci, 1, —2) 

x-y e 
_[ x? + y? _ | e“cosv _ 

(e) Fo =[ 22% |. cue =[ oaee |. Uo = (0,0) 

x+2y 
2 

() Fay=| x-» |. Go.m=[ 90% |. we =0.-2 

x“+y 


21. Suppose that F and G are continuously differentiable on R”, with values in R”, and 
let H = F 0G. Show that 


d(hy,h2,...,hn) = a(fi. ta, --+s In) O(£1, 82,---, Zn) 


O(u1,U2,...,Un)  0(%1, X2,..., Xn) O(u1, U2, ..., Un)” 
Where should these Jacobians be evaluated? 


22. Suppose that F : R” — R” and X is a limit point of Dg contained in Dr. Show 
that F is continuous at X if and only if limp F(X;) = F(X) whenever {X;} is a 
sequence of points in Dy such that limp... X_ = X. HINT: See Exercise 5.2.15. 


23. Suppose that F : R” — R” is continuous on a compact subset S of IR”. Show that 
F(S) is a compact subset of R”. 


6.3 THE INVERSE FUNCTION THEOREM 


So far our discussion of transformations has dealt mainly with properties that could just as 
well be defined and studied by considering the component functions individually. Now we 
turn to questions involving a transformation as a whole, that cannot be studied by regarding 
it as a collection of independent component functions. 


In this section we restrict our attention to transformations from R” to itself. It is useful 
to interpret such transformations geometrically. If F = (fi, fo,..., fn), we can think of 
the components of 


F(X) = (fi (X), fo(X),.--. fn(X)) 
as the coordinates of a point U = F(X) in another “copy” of R”. Thus, U = (1, uv2,...,Un), 
with 
ui = fi(X), u2= fo(%), «..., Un = fn(X). 
We say that F maps X to U, and that U is the image of X under F. Occasionally we will 
also write du;/0x; to mean 0f;/dx;. If S C Dr, then the set 


F(S) = {U|U = F(X), Xe S$} 


is the image of S under F. 


We will often denote the components of X by x, y, ..., and the components of U by u, 
Usises 
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Example 6.3.1 If 


2. 2 
| s |=Ron=| O22 |: 


then 
u=fAG,y=x?+y’, v= f(x,y) =x? -y’, 
and 
7) Xx, 0 x, 
Ux(x,y) = ey) =2x, Uy, y)= ney) = 2y, 
Ofo(x, Ofo(x, 
vx(x,y) = Ae») =2x, w(x,y)= oe uy 


To find F(R), we observe that 
utv = 2x?, u—v =2y?, 


so 
F(R?) CT = {(u,v)|ut+tv>0,u—v> 0}, 

which is the part of the wv-plane shaded in Figure 6.3.1. If (u,v) € T, then 

re a) | u 

a 3 a 


so F(R?) = T. 


A u-v=0 


> u 


u+v=0 


Figure 6.3.1 
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Invertible Transformations 


A transformation F is one-to-one, or invertible, if F(X) and F(X2) are distinct whenever 
X, and X2 are distinct points of Dg. In this case, we can define a function G on the range 


R(F) = {U|U = F(X) for some X € Dy} 
of F by defining G(U) to be the unique point in Dy such that F(U) = U. Then 
Dg = R(F) and R(G) = Dy. 
Moreover, G is one-to-one, 
G(F(X)) =X, Xe Dr, 


and 
F(G(U)) =U, Ue De. 


We say that G is the inverse of F, and write G = F-!. The relation between F and G is 
symmetric; that is, F is also the inverse of G, and we write F = G". 


Example 6.3.2 The linear transformation 


| s [=ner=[ 233 | (6.3.1) 


maps (x, y) to (wu, v), where 
u=Xx-Yy, 


a rH (6.3.2) 


L is one-to-one and R(L) = R?, since for each (u,v) in R? there is exactly one (x, y) 
such that L(x, y) = (u,v). This is so because the system (6.3.2) can be solved uniquely 
for (x, y) in terms of (u, v): 


x= $(u + v), 
; (6.3.3) 
y= z(ut+v). 
Thus, 
4 1 u+tu 
1 ns 
L (u,v) = Al mle ky |. 
Example 6.3.3 The linear transformation 
ul _ _ x+ y 
v ]=He»= 2x +2y 
maps (x, y) onto (uw, v), where 
ere (6.3.4) 


v=2x+2y. 
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L is not one-to-one, since every point on the line 
x-+y=c_ (constant) 


is mapped onto the single point (c, 2c). Hence, L; does not have an inverse. | 


The crucial difference between the transformations of Examples 6.3.2 and 6.3.3 is that 
the matrix of L is nonsingular while the matrix of L, is singular. Thus, L (see (6.3.1)) can 


be written as 
u 1 -l x 
ee aibae ae 


where the matrix has the inverse 


11 
2 2 
iil 
2 2 


(Verify.) Multiplying both sides of (6.3.5) by this matrix yields 


| 

Ne 
IF NR 
SS 
eek 
| 
ll 
1 
<8 
| 


which is equivalent to (6.3.3). 


Since the matrix 
1 1 
2 2 


of Ly is singular, (6.3.4) cannot be solved uniquely for (x, y) in terms of (u,v). In fact, it 
cannot be solved at all unless v = 2u. 


The following theorem settles the question of invertibility of linear transformations from 
IR” to R”. We leave the proof to you (Exercise 6.3.2). 


Theorem 6.3.1 The linear transformation 
U=L(X) =AX (R” >R’") 
is invertible if and only if A is nonsingular, in which case R(L) = R” and 


LW) =A'U. 


Polar Coordinates 


We will now briefly review polar coordinates, which we will use in some of the following 
examples. 


The coordinates of any point (x, y) can be written in infinitely many ways as 


x=rcos#é, y=rsin0, (6.3.6) 
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where 


r2 = x2 4 y? 


and, if r > 0, @ is the angle from the x-axis to the line segment from (0, 0) to (x, y), 
measured counterclockwise (Figure 6.3.2). 


Figure 6.3.2 


For each (x,y) 4 (0,0) there are infinitely many values of 6, differing by integral 
multiples of 27, that satisfy (6.3.6). If is any of these values, we say that 6 is an argument 
of (x, y), and write 

6 = arg(x, y). 


By itself, this does not define a function. However, if ¢ is an arbitrary fixed number, then 
0 =arg(x,y), @59<G+ 2x, 
does define a function, since every half-open interval [¢,@ + 27) contains exactly one 


argument of (x, y). 


We do not define arg (0, 0), since (6.3.6) places no restriction on 6 if (x, y) = (0, 0) and 
therefore r = 0. 


The transformation 


| @ |= 6e)= , & Sarg(x,y) <p +2, 
arg(x, y) 


is defined and one-to-one on 


De = {(x, y) |, ») # 0,09}, 


and its range is 
RG) = {(7,9) |r >0,¢ <0 <o+4+2z}. 
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For example, if ¢ = 0, then 


J/2 
G(1,1) = 


4 
since 2/4 is the unique argument of (1, 1) in [0, 277). If @ = z, then 


J2 
On a 
4 


G(1,1) = 


since 97/4 is the unique argument of (1, 1) in [z, 37). 


If arg(xo, Yo) = @, then (xo, yo) is on the half-line shown in Figure 6.3.3 and G is 
not continuous at (xo, yo), since every neighborhood of (xo, yo) contains points (x, y) for 
which the second component of G(x, y) is arbitrarily close to @ + 27, while the second 
component of G(xo, yo) is @. We will show later, however, that G is continuous, in fact, 
continuously differentiable, on the plane with this half-line deleted. 


(Xp; Yo) 


Figure 6.3.3 


Local Invertibility 


A transformation F may fail to be one-to-one, but be one-to-one on a subset S of Dp. By 
this we mean that F(X,) and F(X2) are distinct whenever X; and X> are distinct points of 
S. In this case, F is not invertible, but if Fs is defined on S by 


Fs(X) =F(X), XeS, 


and left undefined for X ¢ S, then Fg is invertible. We say that Fg is the restriction of F 
to S, and that KF’ is the inverse of F restricted to S. The domain of Fr, is F(S). 
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If F is one-to-one on a neighborhood of Xo, we say that F is locally invertible at Xo. If 
this is true for every Xo ina set S, then F is locally invertible on S. 


Example 6.3.4 The transformation 


7 x2 — y? 
: ]=Fon -| diy (6.3.7) 
is not one-to-one, since 
F(—x,—y) = F(x, y). (6.3.8) 


It is one-to-one on S if and only if S' does not contain any pair of distinct points of the form 
(Xo, Yo) and (—x9, —yo); (6.3.8) implies the necessity of this condition, and its sufficiency 
follows from the fact that if 


F(x1, y1) = Fo, yo), (6.3.9) 
then 
(x1, ¥1) = (Xo, Yo) or (%1, 1) = (—X0. —Yo). (6.3.10) 
To see this, suppose that (6.3.9) holds; then 
Xt — Yi =%9 — Yo (6.3.11) 
and 
X1y1 = Xoo. (6.3.12) 


Squaring both sides of (6.3.11) yields 
xt —2xt yt + YT = x9 — 2xOYG + Yo- 


This and (6.3.12) imply that 


xf —x9 = ¥9 — Vie (6.3.13) 
From (6.3.11), ; ; . F 
Xi -—Xp =i -Yo- (6.3.14) 


Factoring (6.3.13) yields 
(xP = xO)T +9) = 0 — YT) + 97). 
If either side of (6.3.14) is nonzero, we can cancel to obtain 
xt + x9 =—Yo — Ji 


which implies that x9 = x1 = yo = y1 = 0, so (6.3.10) holds in this case. On the other 
hand, if both sides of (6.3.14) are zero, then 


X1=+xX0, Yi = +yo. 


From (6.3.12), the same sign must be chosen in these equalities, which proves that (6.3.8) 
implies (6.3.10) in this case also. 
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We now see, for example, that F is one-to-one on every set S of the form 
S= {(x, y) |ax + by > 0}, 


where a and b are constants, not both zero. Geometrically, S is an open half-plane; that is, 
the set of points on one side of, but not on, the line 


ax +by =0 
(Figure 6.3.4). Therefore, F is locally invertible at every Xo # (0,0), since every such 


point lies in a half-plane of this form. However, F is not locally invertible at (0,0). (Why 
not?) Thus, F is locally invertible on the entire plane with (0, 0) removed. 


ax + by>0 


(a, b) 


Figure 6.3.4 


It is instructive to find F.! for a specific choice of S. Suppose that S' is the open right 
half-plane: 
S = {(x,y)|x > 0}. (6.3.15) 


Then F(S) is the entire wv-plane except for the nonpositive u axis. To see this, note that 
every point in S can be written in polar coordinates as 


x=rcos#é, y=rsind, r>0, -~<@é< 


Therefore, from (6.3.7), F(x, y) has coordinates (u,v), where 


u =x? — y* = r?(cos” 6 — sin? 0) = r? cos 206, 


v = 2xy = 2r* cos sind = r7sin20. 
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Every point in the wv-plane can be written in polar coordinates as 
u=pcosa, v=psina, 


where either p = 0 or 


p=vu?+v2>0, -1 <a<n, 


and the points for which p = 0 ora = —z are of the form (u, 0), withu < 0 (Figure 6.3.5). 
If (u,v) = F(x, y) for some (x, y) in S, then (6.3.15) implies that p > 0 and -—1 <a < 
mz. Conversely, any point in the wv-plane with polar coordinates (p, @) satisfying these 
conditions is the image under F of the point 


(x, y) = (p'/? cosa/2, p'/* sina/2) € S. 
Thus, 
(u? + v?)"/4 cos(arg(u, v)/2) 


Fs! (u, v= , —m <arg(u,v) <7. 
(u2 + v?)!/4 sin(arg(u, v)/2 


Figure 6.3.5 


Because of (6.3.8), F also maps the open left half-plane 
Si = {(, y)|x <0} 
onto F(S), and 


(u2 + v?)!/4 cos(arg(u, v)/2) 
Fs) (u,v) = , mw <arg(u,v) < 3x, 
(u2 + v?)!/4 sin(arg(u, v)/2) 


= —F,'(u, v). 
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Example 6.3.5 The transformation 


ul _ _ | e*cosy 
v = F(x, y) = e* sin y (6.3.16) 
is not one-to-one, since 
F(x, y + 2k) = F(x, y) (6.3.17) 


if k is any integer. This transformation is one-to-one on a set S if and only if S does not 
contain any pair of points (xo, yo) and (xo, yo + 2k2), where k is a nonzero integer. This 
condition is necessary because of (6.3.17); we leave it to you to show that it is sufficient 
(Exercise 6.3.8). Therefore, for example, F is one-to-one on 


So = {(x, y)| -co<x <0, ¢<y<+2n} (6.3.18) 


where ¢ is arbitrary. Geometrically, Sg is the infinite strip bounded by the lines y = @ and 
y = @ + 2m. The lower boundary is in Sg, but the upper is not (Figure 6.3.6). Since every 
point is in the interior of some such strip, F is locally invertible on the entire plane. 


a 


Figure 6.3.6 


The range of Fs, is the entire wv-plane except the origin, since if (u,v) # (0, 0), then 


(u, v) can be written uniquely as 
u |_| pcosa 
v | | psina |’ 


p>0, @<a<o+2z, 


where 


so (u, v) is the image under F of 
(x, y) = (logp,a) € S. 
The origin is not in R(F), since 


|F(x, y)|? = (e* cos y)? + (e* siny)? = e** £0. 
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Finally, 


log(u2 + v?)!/2 
Fs) (u,v) = , &<arg(u,v) <@+2n. 
arg(u, v) 


The domain of Fs) is the entire wv-plane except for (0, 0). 


Regular Transformations 


The question of invertibility of an arbitrary transformation F : R” — R” is too general to 
have a useful answer. However, there is a useful and easily applicable sufficient condition 
which implies that one-to-one restrictions of continuously differentiable transformations 
have continuously differentiable inverses. 


To motivate our study of this question, let us first consider the linear transformation 


aii ai2-°-"° Qin x1 

421 422 ‘** 42n X2 
F(X) = AX = 

Gn1 Gn2 *** Ann Xn 


From Theorem 6.3.1, F is invertible if and only if A is nonsingular, in which case R(F) = 
IR” and 
F'@) =A'U. 


Since A and A“! are the differential matrices of F and F~', respectively, we can say that a 
linear transformation is invertible if and only if its differential matrix F’ is nonsingular, in 
which case the differential matrix of F~! is given by 


(Fly = (F’)7! . 


Because of this, it is tempting to conjecture that if F : R” — R” is continuously differen- 
tiable and A’(X) is nonsingular, or, equivalently, J/F(X) 4 0, for X in a set S, then F is 
one-to-one on S. However, this is false. For example, if 


F(x, y) = e* cos y |; 


e* siny 


then 
e*cosy —e*siny 


dE) = e*siny  e* cosy 


| =e £0, (6.3.19) 


but F is not one-to-one on R?* (Example 6.3.5). The best that can be said in general is 
that if F is continuously differentiable and JF(X) # 0 in an open set S, then F is locally 
invertible on S, and the local inverses are continuously differentiable. This is part of the 
inverse function theorem, which we will prove presently. First, we need the following 
definition. 
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Definition 6.3.2 A transformation F : R” — R” is regular on an open set S if F is 
one-to-one and continuously differentiable on S, and JF(X) 4 Oif X © S. We will also 
say that F is regular on an arbitrary set S if F is regular on an open set containing S. 


Example 6.3.6 If 


Xe _ 
Fe =| 27? | 
(Example 6.3.2), then 
1 
Fs.) =| | |=2: 


so F is one-to-one on R2. Hence, F is regular on R2. 
If 


(Example 6.3.3), then 
JF(x,y) = | 


so F is not regular on any subset of R?. 


If F : 
XxX _ 
Fon=| 7" | 


(Example 6.3.4), then 


2x —2y 


= 5p 2 
2y 2x ae ey hs 


JF(x,y) = | 


so F is regular on any open set S on which F is one-to-one, provided that (0,0) ¢ S. For ex- 
ample, F is regular on the open half-plane {(x, y) | x Oo}, since we saw in Example 6.3.4 
that F is one-to-one on this half-plane. 


If 
_ | e* cosy 
Ba) e* cos y 


(Example 6.3.5), then JF(x, y) = e?* (see (6.3.19)), so F is regular on any open set on 
which it is one-to-one. The interior of Sg in (6.3.18) is an example of such a set. 


Theorem 6.3.3 Suppose that F : R" — R" is regular on an open set S, and let 
G= Ee Then F(S) is open, G is continuously differentiable on F(S), and 


G’(U) = (F'(X))!, where U =F(X). 


Moreover, since G is one-to-one on F(S), G is regular on F(S). 
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Proof We first show that if Xo € S, then a neighborhood of F(Xo) is in F(S). This 
implies that F(S') is open. 


Since S is open, there is a p > O such that B,(Xo) C S. Let B be the boundary of 
B,(Xo); thus, 
B = {|X}|X—Xo| =p. (6.3.20) 


The function 
o(X) = |F(X) — F(Xo)| 


is continuous on S and therefore on B, whichis compact. Hence, by Theorem 5.2.12, there 
is a point X; in B where o(X) attains its minimum value, say m, on B. Moreover, m > 0, 
since X; # Xo and F is one-to-one on S. Therefore, 


|F(X) —F(Xo)|=>m>0 if |X—Xo| =p. (6.3.21) 
The set 
{U | |U — F(Xo)| < m/2} 


is a neighborhood of F(Xo). We will show that it is a subset of F(S). To see this, let U be 
a fixed point in this set; thus, 
|U — F(Xo)| < m/2. (6.3.22) 


Consider the function 
o,(X) = |U—F(X)/, 


which is continuous on S. Note that 
m2 
01(X) = ae if |X—Xo| =p, (6.3.23) 


since if |K — Xo| = p, then 


|U — F(X)| = |(U — F(Xo)) + (F(Xo) — F(X))| 
> ||F(Xo) — F(X)| — |U — F(Xo)]|| 
m m 
Shi > = =; 
7 3 
from (6.3.21) and (6.3.22). 


Since oj is continuous on S, oj attains a minimum value jz on the compact set B,(Xo) 
(Theorem 5.2.12); that is, there is an X in B,(Xo) such that 


01 (X) => 01(X) =p, X € By(Xo). 


Setting X = Xo, we conclude from this and (6.3.22) that 


ay m2 
o1(X) = pw < 01 (Xo) < a 


Because of (6.3.20) and (6.3.23), this rules out the possibility that Xe B,soXe By(Xo). 
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Now we want to show that jz = 0; that is, U = F(X). To this end, we note that o; (X) 
can be written as 


o1(X) = ou; — fj (X))?, 
j=l 


so 0; is differentiable on B,(Xo). Therefore, the first partial derivatives of 0; are all zero 


at the local minimum point X (Theorem 5.3.11), so 


Shoes. tein 
aaj OX; 
or, in matrix form, 
F’(X)(U — F(X)) = 0. 


Since F’(X) is nonsingular this implies that U = F(X) (Theorem 6.1.13). Thus, we have 
shown that every U that satisfies (6.3.22) is in F(S). Therefore, since Xo is an arbitrary 
point of S, F(S) is open. 


Next, we show that G is continuous on F(S'). Suppose that Up € F(S) and Xo is the 
unique point in S such that F(Xo) = Uo. Since F’ (Xo) is invertible, Lemma 6.2.6 implies 
that there is a A > 0 and an open neighborhood N of Xo such that N C S and 


|F(X) — F(Xo)| > AIK—Xo| if XEN. (6.3.24) 


(Exercise 6.2.18 also implies this.) Since F satisfies the hypotheses of the present theorem 
on N, the first part of this proof shows that F(V) is an open set containing Up = F(Xo). 
Therefore, there is ad > 0 such that X = G(U) is in N if U € Bs(Uo). Setting X = G(U) 
and Xo = G(Up) in (6.3.24) yields 


|F(G(U)) — F(G(Uo))| = AIG) — G(Up)| if U€ Bs(Uo). 


Since F(G(U)) = U, this can be rewritten as 
1 
|IG(U) — G(Uo)| < re —Uo| if Ue Bs(Uo), (6.3.25) 


which means that G is continuous at Ug. Since Ug is an arbitrary point in F(S), it follows 
that G is continous on F(S). 


We will now show that G is differentiable at Uo. Since 
G(F(X)) =X, XeS, 
the chain rule (Theorem 6.2.8) implies that if G is differentiable at Up, then 


G’ (Uo) F' (Xo) =I 
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(Example 6.2.3). Therefore, if G is differentiable at Uo, the differential matrix of G must 
be 
G' (Up) = [F'(Xo)]™. 


so to show that G is differentiable at Up, we must show that if 


G(U) — G(Uo) — [F'(Xo)]"'(U — Uo) 


aa |U — Uo| 


(U ZU), (6.3.26) 


then 
lim H U = 0. 6.3.27 


Since F is one-to-one on S and F(G(U)) = U, it follows that if U 4 Up, then G(U) 4 
G(Uo). Therefore, we can multiply the numerator and denominator of (6.3.26) by |G(U) — 
G(Up)| to obtain 


HU) = [EO = Gol (se ae) 


|U — Uo| |G(U) — G(Up)| 

_ _|GU) — GWo)| [F'(Xo) |" ¢ — Up — F'(X0) (GU) — aoe 
[U—Uol : |G(U) — GU)| 

if 0 < |U—Uo| < 6. Because of (6.3.25), this implies that 


Paar _1, |U — Uo — F’(Ko)(GU) — G(Up)) 
JHU)! < SIF Xo I See 


if 0 < |U—Upo| < 6. Now let 


U — Uo — F’ (Xo) (G(U) — G(U 
HW) — UW =F KoNGU) ~ Go) 
|G(U) — G(Uo)| 
To complete the proof of (6.3.27), we must show that 
lim H,(U) =0. (6.3.28) 
U-Uo 
Since F is differentiable at Xo, we know that if 


F(X) — F(Xo) — F’(Xo)(X — Xo) 


H2(X) = li 
2(X) oe X—Xol 


then 
ls H,(X) = 0. (6.3.29) 
Since F(G(U)) = U and Xp = G(U), 


H,(U) = H2(G(U)). 
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Now suppose that « > 0. From (6.3.29), there is a 6; > 0 such that 
|H2(X)|<e if O<|X—Xo| = |K—G(Uo)| < 61. (6.3.30) 
Since G is continuous at Uo, there is a 52 € (0, 5) such that 
IG(U) —G(Uo)| < 61 if 0 < |U—Uo| < b2. 
This and (6.3.30) imply that 
|H; (U)| = |H2(G(U))| <e if O<|U-—Up| < dbo. 


Since this implies (6.3.28), G is differentiable at Xo. 


Since Uo is an arbitrary member of F(), we can now drop the zero subscript and 
conclude that G is continuous and differentiable on F(V), and 


G’(U) = [F(X)]"!, Ue FN). 


To see that G is continuously differentiable on F(N), we observe that by Theorem 6.1.14, 
each entry of G’(U) (that is, each partial derivative 0g;(U)/du;, 1 < i,j <n) can be 
written as the ratio, with nonzero denominator, of determinants with entries of the form 


af(GU)) 


3.31 
Day (6.3.31) 


Since df; /dxs is continuous on N and G is continuous on F(NV), Theorem 5.2.10 implies 
that (6.3.31) is continuous on F(V). Since a determinant is a continuous function of its 
entries, it now follows that the entries of G’(U) are continuous on F(N). aa] 


Branches of the Inverse 


If F is regular on an open set S, we say that F;! is a branch of F~'. (This is a convenient 
terminology but is not meant to imply that F actually has an inverse.) From this definition, 
it is possible to define a branch of F~! ona set T C R(F) if and only if T = F(S), where 
F is regular on S. There may be open subsets of R(F) that do not have this property, and 
therefore no branch of F~! can be defined on them. It is also possible that T = F(S,) = 
F(S2), where S; and S> are distinct subsets of Dy. In this case, more than one branch of 
F~! is defined on T. Thus, we saw in Example 6.3.4 that two branches of F~! may be 
defined on a set T. In Example 6.3.5 infinitely many branches of F~! are defined on the 
same set. 


It is useful to define branches of the argument To do this, we think of the relationship 
between polar and rectangular coordinates in terms of the transformation 


; = F(r,0) = SOE le (6.3.32) 


r sin@ 


where for the moment we regard r and @ as rectangular coordinates of a point in an r6- 
plane. Let S be an open subset of the right half of this plane (that is, S C {@ 0) | r> 0}) 
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that does not contain any pair of points (r, 0) and (r, 0-+2k:zr), where k is a nonzero integer. 
Then F is one-to-one and continuously differentiable on S$, with 


ji _ | cos@ —rsiné 
PG) = sind rcosé ee 
and 
JF(r,0) =r>0, (r,O)ES. (6.3.34) 


Hence, F is regular on S. Now let T = F(S), the set of points in the xy-plane with 
polar coordinates in S. Theorem 6.3.3 states that T is open and Fs has a continuously 
differentiable inverse (which we denote by G, rather than F<', for typographical reasons) 


; V/x2 + y2 
| ¢ |= G6. = ; Key, 
arg s(x, y) 


where arg, (x, y) is the unique value of arg(x, y) such that 


(r,0) = (Vv? + y?, args (x, ¥)) eS. 


We say that arg,(x, y) is a branch of the argument defined on T. Theorem 6.3.3 also 
implies that 


4 cos@  sin@ 
G(x, y) = [F'(r, 0)| =| _ sin 8 cosé (see (6.3.33)) 
r r 


x y 
vee tye VEL | (see (6.3.32)). 


x2 4 y2 x24 y? 


Therefore, 


DBRS OMEN (63.35) 
ax x2 + y? dy x2 + y? 


A branch of arg(x, y) can be defined on an open set T of the xy-plane if and only if 
the polar coordinates of the points in T form an open subset of the r@-plane that does not 
intersect the 6-axis or contain any two points of the form (r, 0) and (7, 0 + 2k), where 
k is a nonzero integer. No subset containing the origin (x, y) = (0,0) has this property, 
nor does any deleted neighborhood of the origin (Exercise 6.3.14), so there are open sets 
on which no branch of the argument can be defined. However, if one branch can be defined 
on 7, then so can infinitely many others. (Why?) All branches of arg(x, y) have the same 
partial derivatives, given in (6.3.35). 
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Example 6.3.7 The set 
T = {(x, y) |. ¥) #0) with x > 0}, 


which is the entire x y-plane with the nonnegative x-axis deleted, can be written as T = 
F(S;), where F is as in (6.3.32), k is an integer, and 


Sk = {(7,0) |r > 0, 2k <0 < 2k +1)z}. 


For each integer k, we can define a branch arg Ss (x, y) of the argument in S; by taking 
args, (x, y) to be the value of arg(x, y) that satisfies 


2km < args, (x,y) < 2(k + Ix. 


Each of these branches is continuously differentiable in 7, with derivatives as given in 
(6.3.35), and 


args, (X,Y) — args, %,y) =2k—j)x, (x,y) €T. 


Example 6.3.8 Returning to the transformation 


u x? — y? 
| |=re =| *, |. 


we now see from Example 6.3.4 that a branch G of F~! can be defined on any subset 7 of 
the wv-plane on which a branch of arg(u, v) can be defined, and G has the form 


_ (u2 + v?)!/4 cos(arg(u, v)/2) 
= G(u,v) = , (u,v)eT, (6.3.36) 
y (u2 + v?)!/4 sin(arg(u, v)/2) 


where arg(u,v) is a branch of the argument defined on T. If Gi and G2 are different 
branches of F~! defined on the same set 7, then Gy = +Gp. (Why?) 
From Theorem 6.3.3, 


= 
G'(u, v) = [Foy] = . — 


ee xy 
~ 202493, -y x J 
Substituting for x and y in terms of u and v from (6.3.36), we find that 


ox oy x 1 


and 
ax oy y 


1 ; 


It is essential that the same branch of the argument be used here and in (6.3.36). | 
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We leave it to you (Exercise 6.3.16) to verify that (6.3.37) and (6.3.38) can also be 
obtained by differentiating (6.3.36) directly. 


ul _ _ | e*cosy 
v tay e* siny 
(Example 6.3.5), we can also define a branch G of F~! on any subset 7 of the wv-plane on 
which a branch of arg(w, v) can be defined, and G has the form 


‘ Seg aie log(u? + v2)? ie (6.3.39) 


Example 6.3.9 If 


y arg(u, v) 


Since the branches of the argument differ by integral multiples of 277, (6.3.39) implies that 
if G, and G» are branches of F~', both defined on T, then 


G, (u, v) — Go(u, v) = aa (k = integer). 


From Theorem 6.3.3, 


: -1 
e*cosy —e*siny 
e*siny  e*cosy 


G'(u, v) = [F'(x, yy = 


_ e *cosy e *siny 
~ | -e*siny e*cosy |" 


Substituting for x and y in terms of u and v from (6.3.39), we find that 


ox oy _ 9 u 

i OO ae 
and 

Ox dy yg = v 

—=-~ =e “siny =e “*v = ——... 

dv ou - u2 + v2 


The Inverse Function Theorem 


Examples 6.3.4 and 6.3.5 show that a continuously differentiable function F may fail to 
have an inverse on a set S even if J/F(X) 4 0 on S. However, the next theorem shows that 
in this case F is locally invertible on S. 


Theorem 6.3.4 (The Inverse Function Theorem) Let F : R" > R" be 
continuously differentiable on an open set S, and suppose that JF(X) 4 0 on S. Then, if 
Xo € S, there is an open neighborhood N of Xo on which ¥ is regular. Moreover, F(N) 
is open and G = Fy is continuously differentiable on F(N), with 


GU) =[F(X)]' (where U= F(X), Ue F(A). 
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Proof Lemma 6.2.6 implies that there is an open neighborhood N of Xo on which F is 
one-to-one. The rest of the conclusions then follow from applying Theorem 6.3.3 to F on 
N. q 


Corollary 6.3.5 [fF is continuously differentiable on a neighborhood of Xo and JF (Xo) # 
0, then there is an open neighborhood N of Xo on which the conclusions of Theorem 6.3.4 
hold. 


Proof By continuity, since JF’(Xo) 4 0, JF’(X) is nonzero for all X in some open 
neighborhood S of Xo. Now apply Theorem 6.3.4. 0 


Example 6.3.10 Let Xo = (1,2, 1) and 


u xty+(z-1)?4+1 
v |=Fix,y.z)=] ytz+a-1)*-1 
w Z+x+(y —2)?7 +3 
Then 
1 1 2z—2 
F(x, y,z)= | 2x-2 1 1 
1 2y-4 1 
so 


110 
JFX)y=|0 1 1/)=2, 
F204 


In this case, it is difficult to describe N or find G = Fe explicitly; however, we know that 
F(N) is a neighborhood of Up = F(Xo) = (4, 2,5), that G(Up) = Xo = (1,2, 1), and 


that 
-1 


1 1 0 1 1 -l 1 
G'(Uo) = [F(X] =] 0 1 1 =5;, ) 1-4 
10 1 - 1 1 
Therefore, 
1 1 1 -l 1 u—4 
G(U) =| 2 ae) 1 1 -l v—2 |+E(U), 
1 —1 1 1 = 5: 
where 
; E(U) 
im ——————-. = 0) 
U+(4,2,5) /(u — 4)? + (v — 2)? + (w — 5)? 
thus we have approximated G near Up = (4, 2, 5) by an affine transformation. | 


Theorem 6.3.4 and (6.3.34) imply that the transformation (6.3.32) is locally invertible 
on S = {(, 0) | r> O}, which means that it is possible to define a branch of arg(x, y) ina 
neighborhood of any point (xo, yo) # (0, 0). It also implies, as we have already seen, that 
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the transformation (6.3.7) of Example 6.3.4 is locally invertible everywhere except at (0, 0), 
where its Jacobian equals zero, and the transformation (6.3.16) of Example 6.3.5 is locally 
invertible everywhere. 


6.3 Exercises 


1. Prove: If F is invertible, then F~! is unique. 
Prove Theorem 6.3.1. 


3. Prove: The linear transformation L(X) = AX cannot be one-to-one on any open set 
if A is singular. HINT: Use Theorem 6.1.15. 


4. Let 
G(x, y) = pee , m/2<arg(x,y) < 5/2. 
arg(x, y) 
Find 
(a) G(O, 1) (b) G(1, 0) (c) G(-1, 0) 
(d) G(2, 2) (e) G(-1,1) 


5. Same as Exercise 6.3.4, except that —2m < arg(x, y) < 0. 


6. (a) Prove: If f : R > R is continuous and locally invertible on (a,b), then f is 
invertible on (a, D). 
(b) Give an example showing that the continuity assumption is needed in (a). 


7. Let —— 
as ee P 
FOX, y)= oy 


(Example 6.3.4) and 
S={(x,y)|ax+by>0} (@?+b? £0). 
Find F(S) and F5!. If 
S,= {(x, y) |ax + by <0}, 


show that F(S;) = FCS) and Fs) = -F;!. 


8. Show that the transformation 


u | _ _ | e* cosy 
v =o = e* sin y 
(Example 6.3.5) is one-to-one on any set S that does not contain any pair of points 
(Xo, Yo) and (xo, Yo + 2k2:), where k is a nonzero integer. 


10. 


11. 


12. 


13. 


14. 
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Suppose that F : R” — R” is continuous and invertible on a compact set S. Show 
that F;' is continuous. HINT: yF,' is not continuous at U in F(S), then there is 


an €9 > 0 anda sequence {U,} in F(S) such that limy_+9. Ux, = U while 
IFs'(Ux) —Fs'(0)| > 0, k= 1. 


Use Exercise 5.1.32 to obtain a contradiction. 
Find F~! and (F"!)’: 


@) |} |=Fen=[ ceed 


—3x+ y 
u —x+y+2z 
(b) | v |=F@,y,2=| 3x+y—4z 
w —x-—y+2z 


In addition to the assumptions of Theorem 6.3.3, suppose that all gth-order (q > 1) 
partial derivatives of the components of F are continuous on S. Show that all qth- 
order partial derivatives of EF,’ are continuous on F(S). 


If 4 : 
: ]=Fe. = eee 


(Example 6.3.1), find four branches G;, G2, G3, and G4 of F~! defined on 
T; = {(u,v) |u+v >0,u—v > Ol, 
and verify that G) (u,v) = (F’(x(u, v), y(u,v))) 1,1 <i <4. 
Suppose that A is a nonsingular x n matrix and 
xt 
2 
U=F(X)=A| 7 
2 
(a) Show that F is regular on the set 
S= {X | ex; >0,1<i <n}, 
where ej = £1,1 <i <n. 
(b) Find F5'(U). (c) Find (F;')/(U). 
Let 0(x, y) be a branch of arg(x, y) defined on an open set S. 


(a) Show that 6(x, y) cannot assume a local extreme value at any point of S. 

(b) Prove: If a ~ 0 and the line segment from (xo, yo) to (ax9, Gyo) isin S, then 
A(axo, ayo) = 4(xo, Yo). 

(c) Show that S cannot contain a subset of the form 


A={»|0<n sve Fy? enh. 
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15. 


16. 


17. 


18. 


19. 


20. 
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ow that no branch of arg(x, y) can be defined on a deleted neighborhoo 
d) Show th branch of arg(x, y be defined deleted neighborhood 
of the origin. 


Obtain Eqn. (6.3.35) formally by differentiating: 
(b) arg(x, y) = sin“? —= 


a) arg(x, y) = cos” —_—_ 
( ) x2 + y? x2 + y2 


(c) ang(x, y) = tan-? 2 
Xx 


Where do these formulas come from? What is the disadvantage of using any one of 
them to define arg(x, y)? 


”, x2 — y? 
fo Jere [Ma | 


(Example 6.3.4), find a branch G of F~! defined on T = {(u, v) | au +bu> O}. 
Find G’ by means of the formula G’(U) = [F’(X)]~! of Theorem 6.3.3, and also by 
direct differentiation with respect to u and v. 


For the transformation 


A transformation 


red =| Te) 


is analytic on a set S if itis continuously differentiable and 
Ux =Vy, Uy =—V,x 


on S. Prove: If F is analytic and regular on S, then Fe is analytic on F(S); that is, 
Xy = Uy and xy = —Uy. 
Prove: If U = F(X) and X = G(U) are inverse functions, then 


O(U1, U2,..-,Un) O(%1,%2,---,Xn) 


——_—_—_—_—_—— = ]. 
O(X1,X2,.--,Xn O(Uy,U2,...,Un) 
Where should the Jacobians be evaluated? 


Give an example of a transformation F : R” — R” that is invertible but not regular 
on R”. 


Find an affine transformation A that so well approximates the branch G of F7! 
defined near Up = F(Xo) that 


G(U) — A(U) 
im ~———— _ = 
U-Uo |U = Uo| 


4,5 _ 
@) | ¥ [=Fon=| i273 J. x= a0 


21. 


22. 


23. 
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(b) | s [=Fe» =| rie i: Xo = (1,1) 


Ixy + xy? 
u Ix?y+x74+z 
(c) v | =F(xXy,2= x3 + yz , X=(0,1,1) 
w x+y+z 
u X COS y COS Z 
(d) v | =F(x,y,z)=| xsinycosz |, Xo = (1,2/2,z) 
w xX sinZ 
If F is defined by 
x r cos 6 cos 
y | =F(r,6,¢) =| rsinOcos¢ 
Zz rsing 


and G is a branch of F~!, find G’ in terms of r, 6, and @. HINT: See Exer- 
cise 6.2.14(b). 
If F is defined by 
rcos 0 
=F(r,0,z) =] rsind 
Zz 


NS & 


and G is a branch of F7!, find G’ in terms of r, 6, and z. HINT: See Exer- 
cise 6.2.14(c). 


Suppose that F : R” — R” is regular on a compact set T. Show that F(0T) = 
dF (T); that is, boundary points map to boundary points. HINT: Use Exercise 6.2.23 
and Theorem 6.3.3 to show that OF(T) C F(0T). Then apply this result with F and 
T replaced by F~! and F(T) to show that F(dT) C dF(T). 


6.4 THE IMPLICIT FUNCTION THEOREM 


In this section we consider transformations from R”*” to R™. It will be convenient to 
denote points in R’*™ by 


(X, U) = (41, X2,...,Xn, U1, U2,...,Um)- 


We will often denote the components of X by x, y, ..., and the components of U by uy, v, 


To motivate the problem we are interested in, we first ask whether the linear system of 
m equations in m + n variables 


a11X1 + Ay2X2 +++) + AinXn + byyuy + bi2u2 + +++ + DimUm = 0 
d21X1 + d22X2 + +++ + AonXn + bau + box + +++ + bomUm = 0 


(6.4.1) 


Ami X1 + Am2X2 + +++ + GmnxXn + bmi + bm2u2 +++: + bmmUm = 0 
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determines uj, U2, ..., Um uniquely in terms of x1, X2,..., Xn. By rewriting the system in 
matrix form as 
AX + BU =0O, 
where 
a1 412 *** Gin bit biz +++ Dim 
421 422 *** dan bo, bog +++ bom 
A= , B= , . : 
Ami Gm2 *** Amn bm bm2 +++ bmm 
x1 uj 
X2 u2 
x= ; , and U= . : 
Xn Um 


we see that (6.4.1) can be solved uniquely for U in terms of X if the square matrix B is 
nonsingular. In this case the solution is 


U = -B'AX. 
For our purposes it is convenient to restate this: If 
F(X, U) = AX + BU, (6.4.2) 
where B is nonsingular, then the system 
F(X, U) = 0 


determines U as a function of X, for all X in R”. 


Notice that F in (6.4.2) is a linear transformation. If F is a more general transformation 
from R”+” to R™, we can still ask whether the system 


F(X, U) = 0, 
or, in terms of components, 
Fi(X1, X2,--+5 Xn, U1, U2,..-,Um) =0 
fo(x1, x2, +++5Xn,U1,U2, .++,Um) = 0 
Sin(%1,.%2,...,%n, U1, U2,...,Um) =, 


can be solved for U in terms of X. However, the situation is now more complicated, even 
ifm = 1. For example, suppose that m = 1 and 


f(x, y,u) = lag Sy =: 
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If x? + y? > 1, then no value of u satisfies 


f(x, y,u) = 0. (6.4.3) 
However, infinitely many functions uv = u(x, y) satisfy (6.4.3) on the set 
S={(x,y) |x? +y? <1}. 
They are of the form 
u(x, y) = €(x, y) V1 — x? = y?, 


where €(x, y) can be chosen arbitrarily, for each (x, y) in S, to be 1 or —1. We can narrow 
the choice of functions to two by requiring that wu be continuous on S; then 


u(x, y) = ~1—x2—- y? (6.4.4) 
or 


u(x, y) =—-V1l—x2—y?. 


We can define a unique continuous solution u of (6.4.3) by specifying its value at a single 
interior point of S. For example, if we require that 


1 1 1 
(2). = = 
(z a) V3 
then u must be as defined by (6.4.4). 


The question of whether an arbitrary system 
F(X, U) = 0 


determines U as a function of X is too general to have a useful answer. However, there 
is a theorem, the implicit function theorem, that answers this question affirmatively in 
an important special case. To facilitate the statement of this theorem, we partition the 
differential matrix of F: R"*™ > R”: 


afi of Of On 9. Sh. 
Ox, 0x2 OXn du, dUu2 OUm 
Of2 Of | df Of 82 ... Sh 
Fo=| dx. dx2 IXn dur dua dum (6.4.5) 


in Ym Yim | Wim Yin Wm 


Ox, Ox2 Oxn Our Our Om 


or 
F’ = [Fx, Fy], 
where Fx is the submatrix to the left of the dashed line in (6.4.5) and Fy is to the right. 
For the linear transformation (6.4.2), Fx = A and Fy = B, and we have seen that the 


system F(X, U) = 0 defines U as a function of X for all X in R” if Fy is nonsingular. The 
next theorem shows that a related result holds for more general transformations. 
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Theorem 6.4.1 (The Implicit Function Theorem) Suppose thatF : R’*™ > 
R™ is continuously differentiable on an open set S of R®*™ containing (Xo, Uo). Let 
F(Xo0, Uo) = 0, and suppose that Fy (Xo, Up) is nonsingular. Then there is aneighborhood 
M of (Xo, Uo), contained in S, on which Fy (X, UV) is nonsingular and a neighborhood N 
of Xo in R” on which a unique continuously differentiable transformation G : R” — R” 


is defined, such that G(Xo) = Uo and 
(X,G(X)) eM and F(X,G(X)) =0 if XEN. (6.4.6) 


Moreover, 


G'(X) = —[Fu(X, G(X)" Fx(X, G(X), XEN. (6.4.7) 
Proof Define ® : R’*” — R"*” by 


ey 
x2 
Xn 
®(X, U) = fi(X, U) (6.4.8) 
f2(X, U) 
tin (X, U) 
or, in “horizontal’’notation by 
®(X, U) = (X, F(X, U)). (6.4.9) 
Then ® is continuously differentiable on S' and, since F(Xo, Uo) = 0, 
®(Xo, Uo) = (Xo, 9). (6.4.10) 
The differential matrix of ® is 
1 QO «- 0 0 QO «-- 0 
0 1 0 0 0 0 
0 0 1 0 0 0 
| i ah | Oh OA A 1 0 
o = Ox, 0x2 OXn OU, OUD dUm = Fx Fy , 
th of th th th | oh 
Ox, 0X2 OXn OU, OUD OUm 


ifm Bm Atm fn Bm Bn 


Oxy Oxo OXn OU, OUD OUm 
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where I is the n x n identity matrix, 0 is the n x m matrix with all zero entries, and Fx 
and Fy are as in (6.4.5). By expanding det(®’) and the determinants that evolve from it in 
terms of the cofactors of their first rows, it can be shown in 7 steps that 


ofr oft af 
J® = det(®’) =| Ou, du2 dUm | = det(Fy). 
Ofm fm fm 


In particular, 
J ®(Xo, Uo) = det(Fu(Xo, Uo) ¥ 0. 


Since ® is continuously differentiable on S, Corollary 6.3.5 implies that ® is regular on 
some open neighborhood M of (Xo, Uo) and that M@ = ®(M) is open. 


Because of the form of ® (see (6.4.8) or (6.4.9)), we can write points of M as (X, V), 
where V € R”. Corollary 6.3.5 also implies that ® has a a continuously differentiable 
inverse I (X, V) defined on M with values in M. Since ® leaves the “X part" of (X, U) 
fixed, a local inverse of ® must also have this property. Therefore, I must have the form 


x1 
X2 


Xn 
P(X,V)=] A(X, V) 


h2(X, V) 


hm(X, V) 


or, in “horizontal” notation, 

I (X, V) = (X, H(X, V)), 
where H : R”*” — R” is continuously differentiable on M. We will show that G(X) = 
H(X, 0) has the stated properties. 

From (6.4.10), (Xo, 0) eM and, since M is open, there is a neighborhood N of Xo in 
IR” such that (X, 0) € M if X € N (Exercise 6.4.2). Therefore, (X, G(X)) = I (X,0) «e M 
if X € N. Since F = ©!, (X,0) = ©(X, G(X)). Setting X = Xo and recalling (6.4.10) 
shows that G(Xo) = Up, since ® is one-to-one on M. 
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Henceforth we assume that X € NV. Now, 


(X,0) = ®(T (X, 0)) (since ® = [~!) 
= 6(X, G(X)) (since I (X, 0) = (X, G(X))) 
= (X, F(X, G(X))) (since ®(X, U) = (X, F(X, U))). 


Therefore, F(X, G(X)) = 0; that is, G satisfies (6.4.6). To see that G is unique, suppose 
that G; : R” — R” also satisfies (6.4.6). Then 


®(X, G(X)) = (X, F(X, G(X))) = (X, 0) 


and 
®(X, G; (X)) = (X, F(X, Gi(X))) = (&, 0) 
for all X in N. Since ® is one-to-one on M, this implies that G(X) = G,(X). 


Since the partial derivatives 


oh; . ; 
z=, Is<ix<m, |l<j Kn, 
Ox; 


are continuous functions of (X, V) on M, they are continuous with respect to X on the 
subset { (X, 0) | XEN of M. Therefore, G is continuously differentiable on NV. To verify 
(6.4.7), we write F(X, G(X)) = 0 in terms of components; thus, 


Fi (41, X2,---5 Xn, 21(X), Z2(K%),..., 8m(K)) =O, L<i<m, XEN. 


Since fj and gi, g2, ..., m are continuously differentiable on their respective domains, 
the chain rule (Theorem 5.4.3) implies that 


afi (X, G(X)) . dfi (X, G(X)) dg,(X) =0, i2i<m 1Si en. (aii 
Ox; = Our Ox; 
or, in matrix form, 
Fx (X, G(X)) + Fy (X, G(X))G’(X) = 0. (6.4.12) 


Since (X, G(X)) € M for all X in N and Fy(X, U) is nonsingular when (X, U) € M, we 
can multiply (6.4.12) on the left by Fy! (x, G(X)) to obtain (6.4.7). This completes the 
proof. u 

In Theorem 6.4.1 we denoted the implicitly defined transformation by G for reasons 
of clarity in the proof. However, in applying the theorem it is convenient to denote the 
transformation more informally by U = U(X); thus, U(Xo) = Up, and we replace (6.4.6) 
and (6.4.7) by 


(X,U(X))€M and X(X,U(X))=0 if XEN, 


and 
U'(X) = —[Fu(X, U(X))|"1Ex(X, U(X), XEN, 
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while (6.4.11) becomes 
Of; = Of; Our, 


| =0, 1Ll<i<m,1<j <n, 6.4.13 
Ox; <= Our Ox; Shas a) ae ( ) 


it being understood that the partial derivatives of uv, and fj are evaluated at X and (X, U(X)), 
respectively. 


The following corollary is the implicit function theorem for m = 1. 


Corollary 6.4.2 Suppose that f : R"*! — R is continuously differentiable on an 
open set containing (Xo, Uo), with f(Xo,uo) = 0 and fy, (Xo, uo) 4 0. Then there is a 
neighborhood M of (Xo, Uo), contained in S, and aneighborhood N of Xo in R” on which 
is defined a unique continuously differentiable function u = u(X) : R” —> R such that 


(X,u(X)) eM and fy(X,u(X)) 40, XEN, 
u(Xo) =uUo, and f(X,u(X))=0, XEN. 
The partial derivatives of u are given by 


_ _ fx Xu) 
ee eae 


Example 6.4.1 Let 
Sx, y,u) = are ae 
and (xo, Yo. Uo) = (4, —-5, z): Then f (xo, yo, Zo) = 0 and 
fx (X, y,u) = —2x, Sy(%, y,u) = —2y, Fulx, y,u) = —2u. 


Since f is continuously differentiable everywhere and f,,(xo, yo, Uo) = —V2 # 0, Corol- 
lary 6.4.2 implies that the conditions 


1 
1—x*—y?-w?=0, u(l/2,-1/2) = —=, 
y / / ep 


determine u = u(x, y) near (xo, yo) = (4, —4) so that 


x(x, vy. u(x, y)) =x 
5G. = 6.4.14 
MO) = Fey, ue.) UD) a 
and 
uy(x,y) = _ Sr yu y) _ _ =v (6.4.15) 


Fux, y, u(x, y)) ux, y)” 
a 


It is not necessary to memorize formulas like (6.4.14) and (6.4.15). Since we know that 
f and u are differentiable, we can obtain (6.4.14) and (6.4.15) by applying the chain rule 
to the identity 


I: ys u(x, y)) = 0. 
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Example 6.4.2 Let 
f(x, y.u) = x3 y7u? + 3xytut = 3x° you? + 12x — 13 
and (xo, Yo, Uo) = (1,—1, 1), so f (x0, Yo, wo) = 0. Then 


fal, y,u) = 3x2y2u? + By4ut — 18x5ySu7 + 12, 
fy(x, yu) = 2x3 yu? + 1d2xy?ut — 18x® you’, 
fulX, yu) = 2x3 y2u + 1L2xy4u3 — 21x? you. 


Since f,(1,—-1, 1) = —7 € 0, Corollary 6.4.2 implies that the conditions 
f(x,y,u)=0, u(l,-l)=1 


determine u as a continuously differentiable function of (x, y) near (1, —1). 


(6.4.16) 


(6.4.17) 


If we try to solve (6.4.16) for u, we see very clearly that Theorem 6.4.1 and Corol- 
lary 6.4.2 are existence theorems; that is, they tell us that there is a functionu = u(x, y) 
that satisfies (6.4.17), but not how to find it. In this case there is no convenient formula for 
the function, although its partial derivatives can be expressed conveniently in terms of x, 


y, and u(x, y): 


AG, y,u(x, y)) 
Sul®, y,u(x, y))’ 


In particular, since u(1, —1) = 1, 


Ux(X,y) = Uy(x,y) = 


0 4 
a een ee a al -, 


Example 6.4.3 Let 
‘ u 
X=] y and U= i , 


and 


2 2 2 2_ 42 
Fou) =| ™* +y*e +z" +Uu v 


x7 +727+4+2u—v 
If Xo = (1, —1, 1) and Up = (0, 2), then F(Xo, Up) = 0. Moreover, 


Fux) =| 4 ai sail re-[ 3 2y oa 


2, —1 2x O 2z 
SO 

0 4 
det(Fy (Xo, Uo)) = | > 4 | = 8 x 0. 


_ AG, y,u(x, y)) 
fulx, y, u(x, y)) 
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Hence, the conditions 
F(X, U) = 0, U(,-1,1) = (0,2) 


determine U = U(X) near Xo. Although it is difficult to find U(X) explicitly, we can 
approximate U(X) near Xo by an affine transformation. Thus, from (6.4.7), 


U'(Xo) = —[Fu(Xo, U(Xo))]- Fx(Xo, U(Xo)) (6.4.18) 


eel 


Therefore, 
x-1 
u(x, y) 0 1 42 6 
| we) [-[ 2 ]+e -8 4 —4 ae ; 
Vim | : | 
x—>(1,-1,1) [(x _ 1)2 + (y + 1)2 4 (z = 1)2]1/2 0 


Again, it is not necessary to memorize (6.4.18), since the partial derivatives of an implic- 
itly defined function can be obtained from the chain rule and Cramer’s rule, as in the next 
example. 


Example 6.4.4 Let u = u(x, y) and v = v(x, y) be differentiable and satisfy 
x? 4 2y? +327 4+? +0 =6 
(6.4.19) 
2x3 + 4y? +277 +u +72 =9 


and 
u(1,—1,0) =—-1, v(i,—-1,0) =2. (6.4.20) 


To find wu, and v;, we differentiate (6.4.19) with respect to x to obtain 


2x + 2uux, +v, =0 
6x7? + uy + 2vvy = 0. 


Therefore, 
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and Cramer’s rule yields 


2x 1 
6x? 2v 6x? — 4xv 
ux =— = 
2u 1 4uv —-1 
1 2v 
and 
2u = 2x 
1 6x? 2x —12x?u 
Vy =— = 
2u 1 4uv—-1 
1 2v 


if 4uv # 1. In particular, from (6.4.20), 


14 14 


—2 2 
ux(1,—-1, 0) _ 79 — 9” vx (1, —1, 0) = = = <5 


Jacobians 


It is convenient to extend the notation introduced in Section 6.2 for the Jacobian of a trans- 


formation F : R” — R”. If fA, fo, ..., fm are real-valued functions of k variables, 
k > m, and &1, &, ..., & are any m of the variables, then we call the determinant 
0&1 0&2 d&m 
0&1 0&2 d&m 
0&1 0&2 d&m 
the Jacobian of fi, fo, ..., fm with respect to £1, &2,..., Em. We denote this Jacobian by 
afi, ho, ey tm) 
A(E1, &2,..-,m) 
and we denote the value of the Jacobian at a point P by 
afi. ho, ae Tn) 
a1. £2... Em) |p 


Example 6.4.5 If 


3x2 +2xy + 2? 
F(x, y,z) = eae ahge : 
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then 
a(fi, fr) _| 6x+2y 2x a(fi. fo) _| 2x 2 
a(x, y) 8x +2y? 4xy d(y, Zz) 4xy 32? 
and 
O(fi, fo) _| 22 6x +4+2y 
A(z,x) | 32% 8x+2y? 
The values of these Jacobians at Xp = (—1, 1, 0) are 
afi. fa) eae ahi. fr) le eles 
~1-6 -4}]~ ° “am7) | ~ | -4 re 
A(x, 9) |x, 6 (yz) fy 0 
and 
a(fi, f2) 0 —4 
“We ae. ae = 0. | 
Xo 


The requirement in Theorem 6.4.1 that Fy (Xo, Uo) be nonsingular is equivalent to 


O(U1,U2,...,Um) 


#0. 
(X0,Uo) 
If this is so then, for a fixed 7, Cramer’s rule allows us to write the solution of (6.4.13) as 


(fis far+++ fis--+» fm) 


GHG Meare) “Got Lge. 
ag OC» fa +++ fir ++ Sm) 
O(Uy,U2,...,Uj,...,Um) 


Notice that the determinant in the numerator on the right is obtained by replacing the ith 
column of the determinant in the denominator, which is 


afi oft 
au; Ox; 
dfs ofa 
du; |. by Ox; 
Ofm Ofm 


So far we have considered only the problem of solving a continuously differentiable 
system 
F(X,U) =0 (F:R"*” > R”) (6.4.21) 
for the last m variables, v1, U2, ..., Um, in terms of the first n, x1, X2,..., X,. This was 
merely for convenience; (6.4.21) can be solved near (Xo, Uo) for any m of the variables in 
terms of the other n, provided only that the Jacobian of /1, f2,..., fm with respect to the 
chosen m variables is nonzero at (Xo, Uo). This can be seen by renaming the variables and 
applying Theorem 6.4.1. 
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Example 6.4.6 Let 


Fi =[ 222] 


be continuously differentiable in a neighborhood of (xo, yo, Zo). Suppose that 
F(xo, yo, Z0) = 0 


and 


af, g) 
O(x, Z) 


#0. (6.4.22) 
(x0,¥0;Z0) 


Then Theorem 6.4.1 with X = (y) and U = (x, z) implies that the conditions 


Sf (x,y,z) =0, g(x,y,z)=0, x(¥0) = x0, Z(Vo) = Zo, (6.4.23) 


determine x and z as continuously differentiable functions of y near yo. Differentiating 
(6.4.23) with respect to y and regarding x and z as functions of y yields 


ix’ + ty - jee =0 
&xx' + gy + B22’ =0. 


Rewriting this as 


tex’ a Sez! = —fy 
&xx' + g2z' =—By, 


and solving for x’ and z’ by Cramer’s rule yields 


| —hy fe af, g) 
,_ | ~8y 8 | _ _ 90,2) 
ae ae Fs) (6.4.24) 
8x 8&z a(x, Z) 
and 
fe hy af, g) 
,_ | &x —8y _ _ 9, y) 
Z= ce ar a rs = aay (6.4.25) 
8x 8&z O(x, Z) 


Equation (6.4.22) implies that 0(f, g)/0(x, z) is nonzero if y is sufficiently close to yo. 
Example 6.4.7 Let Xo = (1, 1,2) and 


f(%,y,2) 
a(x, y,Z) 


_ [ 6x +6y + 423-44 


Foy.) =| =| Sei | 
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Then F(Xo) = 0, 


af, g) _ 6 1277 
O(x, Z) ~ | —2x 8 : 
and 
wee) =) . [= 144 40. 
(x, Z) Ha ah 


Therefore, Theorem 6.4.1 with X = (y) and U = (x, z) implies that the conditions 


(x,y,z) =0, g(x, y,z) =9, 
and 
x(1)=1, zl) =2, (6.4.26) 


determine x and z as continuously differentiable functions of y near yo = 1. From (6.4.24) 
and (6.4.25), 


a(f. g) | 6 122? 

she SOE) PB) 
af, g) 6 122? 2+ x22 
a(x, z) | —2x 8 

and 
df, 8) | 6 6 
fe d(x, y) = —2x —2y _ ya-* 
~afge | 6 1222| 442xz2° 

a(x, Z) | —2x 8 | 


These equations hold near y = 1. Together with (6.4.26) they imply that 
x(1)=-1, z(1I)=0. 


Example 6.4.8 Continuing with Example 6.4.7, Theorem 6.4.1 implies that the con- 
ditions 
f@yD)=90, ge y2)=90, yA=1, <i) =2 


determine y and z as functions of x near x9 = 1, since 


fg) _ | 6 122? 
d(y, Z) —2y 8 
and 
oF, 8) -| oa8 [= 144 40. 
d(y, Z) ne 2 8 


However, Theorem 6.4.1 does not imply that the conditions 


S(x,y,2)=0, g(x,y,z)=0, xQ2)=1, yQ)=1 
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define x and y as functions of z near zo = 2, since 


vf 8) _ | 6 6 | 
a(x, y) —2x —2y 
and 
aS. 8) -| 6 6 Jo 
Mla ig | 2 : 
We close this section by observing that the functions uj, u2, ..., Um defined in Theo- 


rem 6.4.1 have higher derivatives if fi, f2,..., fm do, and they may be obtained by differ- 
entiating (6.4.13), using the chain rule. (Exercise 6.4.17). 


Example 6.4.9 Suppose that wu and v are functions of (x, y) that satisfy 
f(x, y,4u,v) =x —u? —v?+9=0 


g(x, y,4¥,v) = y—u? +v72-10=0. 


Then 
(fg) | —-2u -2v|__¢ 
d(u, v) —2u—_2v : 
From Theorem 6.4.1, if wu 4 0, then 
1a) 1 ftw] od 
~*~ 8uv d(x,v) 8uv| 0 204] 4y’ 
y= Lhe) 10-2) 
~~ 8uv d(y,v) 8uv} 1 2v | 4y’ 
» - L868 _ 1 | -mw if od 
~*~" 8uv d(u,x)  8uv —2u 0} 4 
1 eg) 1 ftw of 
~ 8uv d(u,y)  8uv —2u 1} dy 


These can be differentiated as many times as we wish. For example, 


Ux 1 
Ce" ia 
— Uy 1 
ey Aye 16u3” 
and 
Vx 1 
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6.4 Exercises 


Solve for U = (u,...) as a function of X = (x,...). 


(a) 1 1 ul 1 -1 x |_| 0 
1 -1 v 2 -3 y | [0 
u—-v+wt+3x+2y=0 

(b) -wtvu+w- x+ y=0 
u+tu-—w + y=0 


3u+ v+y=sinx 
(c) u+2v+x =sin 
= y 


2u+2v+ w+2x+2y+ z=0 
(d) w- v+2w+ x- y+2z=0 
3u+2v-—- w+3x+2y- z=0 


Suppose that Xo € IR” and Up € R”. Prove: If Nj is a neighborhood of (Xo, Uo) 
in R”*”, there is a neighborhood N of Xo in R” such that (X,Up) €¢ N; ifX € N. 


Let (Xo, Uo) be an arbitrary point in R"*”. Give an example of a function F : 
R"+” _, R”™ such that F is continuously differentiable on R’*™, F(Xo, Uo) = 0, 
Fy (Xo, Uo) is singular, and the conditions F(X, U) = 0 and U(X) = Yo 


(a) determine U as a continuously differentiable function of X for all X; 

(b) determine U as a continuous function of X for all X, but U is not differentiable 
at Xo; 

(c) do not determine U as a function of X. 


Let u = u(x, y) be determined near (1, 1) by 
x?yu + 2xy7u3 — 3x3 y3v? =0, u(l,1) =1. 
Find ux (1, 1) and wu, (1, 1). 
Let u = u(x, y, Z) be determined near (1, 1, 1) by 
x? y>z7uP + 2xy2u3 —3x3z2u =0, u(,1,1) =1. 


Find ux (1, 1,1), wy(, 1, 1), and w,(1, 1, 1). 

Find u(Xxo, Yo), Ux (Xo, Yo), and uy (xo, Yo). 

(a) 2x?+y?+ue“=6, (xo, Yo) = (1,2) 

(b) u(x +1)+x(y+2)+ y(u-—2)=0, (x0. yo) = (-1,—2) 
(c) 1—e"“sin(x + y)=0, (xo, yo) = (17/4, 27/4) 

(d) xlogu+ylogx+ulogy =0, (xo, yo) = (1,1) 
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10. 


11. 


12. 
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Find u(xo, yo), Ux (Xo, Yo), and wy (Xo, yo) for all continuously differentiable func- 
tions u that satisfy the given equation near (Xo, yo). 


(a) 2x?y4 —3uxy? + u?x*ty? =0; (xo, yo) = (1,1) 
(b) cosucosx +sinusiny =0; (xo, yo) = (0,7) 


Suppose that U = (u, v) is continuously differentiable with respect to (x, y, z) and 


satisfies 
x? + dy? + 2? —2u? +0? =—-4 


(x+z)? +u-—v=-3 
and 
u(1,4,-1) =—2, v(1,4,-1) =1. 

Find U'(1, $,—1). 
Let u and v be continuously differentiable with respect to x and satisfy 

u+2u? +074 x742v—x=0 

xuv +e" sin(v +x) =0 

and u(0) = v(0) = 0. Find w’(0) and v’(0). 
Let U = (u, v, w) be continuously differentiable with respect to (x, y) and satisfy 

x?y + xy? +u?—-(v+w)? =-3 


etY _y—v—-w=-2 
(x+y)? tutv+tw*= 3 


and U(1,—1) = (1,2, 0). Find U’(1, —1). 


Two continuously differentiable transformations U = (u,v) of (x, y) satisfy the 
system 


xyu —4yu + 9xv =0 
2xy —3y* +07 =0 


near (Xo, Yo) = (1,1). Find the value of each transformation and its differential 
matrix at (1, 1). 


Suppose that u, v, and w are continuously differentiable functions of (x, y, z) that 
satisfy the system 


e* cosy + e%cosu +e" cosw+x =3 
e* siny + e* sinu + e” cosw =1 
e*tany +e*tanu+e"tanw+z=0 


near (Xo, Yo, Zo) = (0,0,0), and u(0,0,0) = v(0,0,0) = w(0,0,0) = 0. Find 
ux (0, 0,0), v(0, 0, 0), and wx (0, 0, 0). 


13. 


14. 


15. 


16. 


17. 
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Let F = (f, g, 2) be continuously differentiable in a neighborhood of Po = (Xo, Yo, Zo, Uo; Vo); 
F(Po) = 0, and 
a(f, g,h) 


a(y, Zy u) Po 
Then Theorem 6.4.1 implies that the conditions 


£0. 


F(x, y,zZ,u,v) =0, y(xo.v0) = uo, Z(X0, vo) = Zo, U(Xo, Vo) = Uo 


determine y, z, and uv as continuously differentiable functions of (x, v) near (xo, Uo). 
Use Cramer’s rule to express their first partial derivatives as ratios of Jacobians. 


Decide which pairs of the variables x, y, z, u, and v are determined as functions of 
the others by the system 


x+2y+3z+ u+6v=0 
2x+4y+ z+2u+2v=0, 


and solve for them. 
Let y and v be continuously differentiable functions of (x, z, u) that satisfy 
x? + Ay? + 2? —2u? + v? = —-4 
(x+z)? +u-—v=-3 


near (Xo, Zo, Yo) = (1, —1, —2), and suppose that 
1 
yi, -1, -2) = 3 v(1,—1,—2) = 1. 


Find y,(1, —1, —2) and v,(1, —1, —2). 
Let u, v, and x be continuously differentiable functions of (w, y) that satisfy 
x*ytxy?+u?—-(vt+wy =-3 
ety —_y—y—w=-2 
(xtyP+utvt+w?= 3 


near (Wo, Yo) = (0, —1), and suppose that 
u(0,-1) =1, v(0,-l)=2, x(0,-1) =1. 


Find the first partial derivatives of u, v, and x with respect to y and w at (0, —1). 


In addition to the assumptions of Theorem 6.4.1, suppose that F has all partial 
derivatives of order < g in S. Show that U = U(X) has all partial derivatives 
of order < gin N. 
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18. 


19. 


20. 
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Calculate all first and second partial derivatives at (xo, yo) = (1, 1) of the functions 
u and v that satisfy 


x74 y?+u? 407 =3 
eae cps. u(i,1)=0, vd,1)=1. 
Calculate all first and second partial derivatives at (xo, yo) = (1, —1) of the func- 
tions u and v that satisfy 
u*—y27=x-—y-2 


2uu=x+y-2, u(i,—1) = -1, v(,-1) = 1. 


Suppose that fi, fo, ..., fx are continuously differentiable functions of X in a 
region S in R”, ¢ is continuously differentiable function of U in a region T of R”, 


(fi(X), fo(X),.... fr (&)) € T, XeS, 
$(fi(X), 2(X),---, (CO) =0, XeES, 


and 
>> 4%,U)>0, UeT. 
j=1 
Show that 
O(fi, fo, ---> Sn) = 


=0, XeS. 
O(X1,X2,..-,Xn) 


CHAPTER 7 


Integrals of Functions 
of Several Variables 


IN THIS CHAPTER we study the integral calculus of real-valued functions of several 
variables. 


SECTION 7.1 defines multiple integrals, first over rectangular parallelepipeds in R” and 
then over more general sets. The discussion deals with the multiple integral of a function 
whose discontinuities form a set of Jordan content zero, over a set whose boundary has 
Jordan content zero. 


SECTION 7.2 deals with evaluation of multiple integrals by means of iterated integrals. 


SECTION 7.3 begins with the definition of Jordan measurability, followed by a derivation 
of the rule for change of content under a linear transformation, an intuitive formulation of 
the rule for change of variables in multiple integrals, and finally a careful statement and 
proof of the rule. This is a complicated proof. 


7.1 DEFINITION AND EXISTENCE OF THE MULTIPLE IN- 
TEGRAL 


We now consider the Riemann integral of a real-valued function f defined on a subset of 
IR”, where n > 2. Much of this development will be analogous to the development in 
Sections 3.1-3 for n = 1, but there is an important difference: form = 1, we considered 
integrals over closed intervals only, but for > 1 we must consider more complicated 
regions of integration. To defer complications due to geometry, we first consider integrals 
over rectangles in R”, which we now define. 


Integrals over Rectangles 


The 
S, X So x-++ x Sy 
of subsets S;, Sz, ..., S, of R is the set of points (x1, X2,...,Xn) in R” such that x; € 
S1,X2 € So,...,Xn € Sp. For example, the Cartesian product of the two closed intervals 
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[a1, bi] x [az, bo] = {(x, y) | a1 < x < bi, ag < y < by} 


is a rectangle in R? with sides parallel to the x- and y-axes (Figure 7.1.1). 


=) 
SP 


Figure 7.1.1 
The Cartesian product of three closed intervals 
[a1, bi] x [az, bo] x [a3, bs] = {(x, yz) |a1 <x <1, ag < y <b, a3 <z <b} 


is arectangular parallelepiped in R? with faces parallel to the coordinate axes (Figure 7.1.2). 


Figure 7.1.2 
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Definition 7.1.1 A coordinate rectangle R in R" is the Cartesian product of n closed 
intervals; that is, 
R= [ay, bi] x [a2, b2] x +++ x [an, Dy]. 


The content of R is 


V(R) = (by — a1) (b2 — a2) +++ (bn — Gn). 


The numbers b; — a1, b2 — dz, ..., bn — ay are the edge lengths of R. If they are equal, 
then R is a coordinate cube. If ay = by for some r, then V(R) = 0 and we say that R is 
degenerate; otherwise, R is nondegenerate. | 


If n = 1, 2, or 3, then V(R) is, respectively, the length of an interval, the area of a 
rectangle, or the volume of a rectangular parallelepiped. Henceforth, “rectangle” or “cube” 
will always mean “coordinate rectangle” or “coordinate cube” unless it is stated otherwise. 

If 

R = [ay, by] X [a2, be] x +++ x [an, by] 
and 
Pr: dy = Gro < Ar, < +++ < Arm, = by 
is a partition of [a,, b;], 1 < r <n, then the set of all rectangles in R” that can be written 
as 


[a1 j1—15 41j1] X [42,jo-1, 42j] X+*+ x [Anjn-1,4nin|, LS jr S mr, LSr <n, 


is a partition of R. We denote this partition by 


P= P, x P2x-+-:x Py (7.1.1) 
and define its norm to be the maximum of the norms of P;, P2, ..., Pn, as defined in 
Section 3.1; thus, 

|| P || = max{]| Pil], || Pall. ---. I Pall}. 


Put another way, || P || is the largest of the edge lengths of all the subrectangles in P. 


Geometrically, a rectangle in R? is partitioned by drawing horizontal and vertical lines 
through it (Figure 7.1.3); in R>, by drawing planes through it parallel to the coordinate axes. 
Partitioning divides a rectangle R into finitely many subrectangles that we can number in 
arbitrary order as Ry, Ro, ..., Rx. Sometimes it is convenient to write 


P ={R,, Ro,..., Re} 


rather than (7.1.1). 
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Figure 7.1.3 


If P = Py x Py x---x P, and P’ = Pj x Pj; x---x P/ are partitions of the same 
rectangle, then P’ is a refinement of P if P! is arefinement of P;, 1 < i <n, as defined in 
Section 3.1. 


Suppose that f is a real-valued function defined on a rectangle Rin R”, P = {Ry, Ro,... 
is a partition of R, and X; is an arbitrary point in R;, 1 < 7 <k. Then 


k 
o=)> f(Xj)V(Rj) 


jJ=1 
isa Riemann sum of f over P.. Since X; can be chosen arbitrarily in R;, there are infinitely 
many Riemann sums for a given function f over any partition P of R. 


The following definition is similar to Definition 3.1.1. 


Definition 7.1.2 Let f be a real-valued function defined on a rectangle R in R”. We 
say that f is Riemann integrable on R if there is a number L with the following property: 
For every € > 0, there is a 5 > 0 such that 


la—L| <e 


if o is any Riemann sum of f over a partition P of R such that || P || < 6. In this case, we 
say that L is the Riemann integral of f over R, and write 


/ f(X)dX = L. ] 
R 


If R is degenerate, then Definition 7.1.2 implies that fp f(X) dX = 0 for any function f 
defined on R (Exercise 7.1.1). Therefore, it should be understood henceforth that whenever 
we speak of a rectangle in R” we mean a nondegenerate rectangle, unless it is stated to the 
contrary. 
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The integral [, f(X)dX is also written as 


[fender @=2 f forr2de.¥.2) @=3) 
or 
/ SF (x1, X2,--+;Xn) d(%1,X2,...,Xn)  (n arbitrary). 
R 
Here dX does not stand for the differential of X, as defined in Section 6.2. It merely 


identifies x1, X2,..., Xn, the components of X, as the variables of integration. To avoid this 
minor inconsistency, some authors write simply fp f rather than fp f(X) dX. 


As in the case where n = 1, we will say simply “integrable” or “integral” when we 
mean “Riemann integrable” or “Riemann integral.” If n > 2, we call the integral of Defi- 
nition 7.1.2 a multiple integral; forn = 2 and n = 3 we also call them double and triple 
integrals, respectively. When we wish to distinguish between multiple integrals and the 
integral we studied in Chapter (7 = 1), we will call the latter an ordinary integral. 


Example 7.1.1 Find /, f(x, y) d(x, y), where 
R =[a,b] x [c,d] 


and 
f@,y)=xt+y. 


Solution Let P; and P2 be partitions of [a, b] and [c, d]; thus, 
Pi :@a@=x9<xX1<-++<x,=b and Pp:c=yo< yi <--+< ys =a. 


A typical Riemann sum of f over P = P, x P2 is given by 


r S 
o= >) iy + mij )ai — X15 — Yi-1). (7.1.2) 
i=1j=1 
where 
Mi-1 Si; SX; and yj-1 < ij < yj. (7.1.3) 
The midpoints of [x;—-1, x;] and [y;-1, yj] are 
= Xj + Xji-1 = yj + Yj-1 
= =) gn ee TAA 
Xj 5 and yj; 5 (714) 
and (7.1.3) implies that 
—, x —Xi-1 _ Pill _ WPI 
l&; — |< ——— ; —< oa (7.1.5) 
and 
a9 oy ME Vt js. all el 
Ing -—V, |< 5 a5 Se (7.1.6) 
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Now we rewrite (7.1.2) as 


o =>) > 0G + 9))Gi — x1) — ¥j-1) 


i=1j=1 
+)> ~~ [ (iz — Xi) + (ny — ¥,)] Gi — X1-1) (7 — Yj-1). 
i=1j=1 
To find de F(x, y) d(x, y) from (7.1.7), we recall that 


iG - 4-1) =b-a, VO; —yj-1) =a -e 


i=l j=l 
(Example 3.1.1), and 


r 


GPP -a@, Vop-yaad? —e? 


i=l j=l 
(Example 3.1.2). 


Gig) 


(7.1.8) 


(7.1.9) 


Because of (7.1.5) and (7.1.6) the absolute value of the second sum in (7.1.7) does not 


exceed 


|| P || = SG — xi-1) (Vj — yj-1) = IP |l bx =) CT, — yj-1) 
j=l 


J=l1j=1 i=1 


= ||P -a)d —c) 
(see (7.1.8)), so (7.1.7) implies that 


o-S° 0G +9 /)Oi — x1); —yj-1)| < |PIG-@d -0). 


i=1 j=1 


It now follows that 


i=1j=1 


SoS xi (xi — 1-0) — Yj-1) = [omic =) 204 - yi-1) 
i=1 j=1 


(7.1.10) 


= (d —c)) 0X; (x; — xj-1) (from (7.1.8) 


i=1 


=a Yi(x7 — x74) (from (7..1.4)) 


= re =a’) (from (7.1.9)). 


Similarly, 
¥ 


S b— 
ye Soy i —Xi-1)(Vj — Yj-1) = 5 “(2 =—"), 


i=1 j=1 
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Therefore, (7.1.10) can be written as 


c b-a 


o — £5 0) 4G? — | < PI>— and - 0). 


Since the right side can be made as small as we wish by choosing || P || sufficiently small, 


[+ vate, 9) = 5 [d - 090? ~ 02) + — ad? — 029]. 


Upper and Lower Integrals 


The following theorem is analogous to Theorem 3.1.2. 


Theorem 7.1.3 /f f is unbounded on the nondegenerate rectangle R in R", then f is 
not integrable on R. 


Proof We will show that if f is unbounded on R, P = {Rj, Ro,..., Rx} is any parti- 
tion of R, and M > 0, then there are Riemann sums o and o’ of f over P such that 


lo —o'|>M. (7.1.11) 
This implies that f cannot satisfy Definition 7.1.2. (Why?) 
Let 
k 
= f&)V(R)) 
j=1 
be a Riemann sum of f over P. There must be an integer i in {1,2,...,k} such that 


M 
X) — f(X;)| > —— 7.1.12 
FO — FOI = TR, (7.1.12) 
for some X in R;, because if this were not so, we would have 


| f(X) — f(X;)| < Xe Rj, lsaj ek, 


M 
V(R;) 
If this is so, then 

|f(X)| = |FCKi) + FX) — F(K,)| < | FCKA)| + [FCO — FCK,)I 


<|f&%&)|+——~, XeER;, 1<j <k. 


M 
V(Rj) 
However, this implies that 


| f(X)| < max 4 | f(X;)| + <j<ks, XER, 


M 
V(R; VR |! ~ 


which contradicts the assumption that f is unbounded on R. 
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Now suppose that X satisfies (7.1.12), and consider the Riemann sum 


o = >> f(X))V(Rj) 


j=l 
over the same partition P, where 
, Xj, iF i, 
a= a jai. 
Since 
lo —o"| = | f(X) — f(Ki)|V(R;), 
(7.1.12) implies (7.1.11). 


aa 


Because of Theorem 7.1.3, we need consider only bounded functions in connection with 
Definition 7.1.2. As in the case where n = 1, it is now convenient to define the upper 
and lower integrals of a bounded function over a rectangle. The following definition is 


analogous to Definition 3.1.3. 


Definition 7.1.4 If f is bounded on a rectangle R in R" and P = {Ry, Ro,..., 


is a partition of R, let 


M; = sup f(X), m; = inf f(X). 
. XeR; 7 XeR; 


The upper sum of f over P is 


k 
S(P) = 95 MjV(Rj), 


J=1 


and the upper integral of f over R, denoted by 
| fevax, 
R 
is the infimum of all upper sums. The lower sum of f over P is 
k 
s(P) = }\mjV(Rj), 
j=l 
and the lower integral of f over R, denoted by 
| fovax, 
JR 


is the supremum of all lower sums. 


The following theorem is analogous to Theorem 3.1.4. 


Rx} 
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Theorem 7.1.5 Let f be bounded on a rectangle R and let P be a partition of R. 
Then 


(a) The upper sum S(P) of f over P is the supremum of the set of all Riemann sums of 
f over P. 


(b) The lower sum s(P) of f over P is the infimum of the set of all Riemann sums of f 
over P. 


Proof Exercise 7.1.5. 


If 
m < f(X) <M for Xin R, 


then 
mV(R) <s(P) < S(P) < MV(R); 


therefore, ie f(X) dX and fp f(X) dX exist, are unique, and satisfy the inequalities 


mV(R) = f F(X) dX < MV(R) 
R 


mV(R) < / F(X) dX < MV(R). 
R 
The upper and lower integrals are also written as 


/ fy) de, y) and i fe. nde,y) @=D, 
R JR 


[ fens adeey.2) and [ feroacey.) (n = 3), 
R YR 
or _ 

[i For 0. -000 0) dl 80580) 


and 
/ SF (x1, X2,..-,Xn) d(X1, X2,..., Xn) (n arbitrary). 
R 


Example 7.1.2 Find /, f(x,y) d(x, y) and te fy) d(x, y), with R = [a,b] x 
[c, d] and 

f@y=Hxty, 
as in Example 7.1.1. | 


Solution Let P; and P2 be partitions of [a, b] and [c, d]; thus, 


Pi :a=XxX9<X1<-++< x, =b and Pp: c=yo<y <-++< ys =a. 
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The maximum and minimum values of f on the rectangle [x;—1, x;]<[yj-1, yj] are x; +); 
and x;-1 + y;-1, respectively. Therefore, 


S(P) = 0 Qi + NG — Mi-DO7 —Yi-V) (7.1.13) 
i=1 j=1 
and 
s(P) = D7 > @i-1 + ¥j-1) i — 24-1) 0 — Yj-1). (7.1.14) 
i=1j=1 


By substituting 


1 
xit yi = 5 |G: Mia) + Oy FY) FOP = si) + OF = ¥ 7-1) 
into (7.1.13), we find that 


1 
S(P) = x + X2 + D3 + D4), (7.1.15) 


where 


B= )0@? - 374) Oy - yy) =? - a) -0), 
i=1 j=l 


Ye = Yi —xi-1) 007 - 7-4) = © —a)(a? -c2), 


i=l j=l 

Bs = Doi — 4-1)? D0; — yj-1) < IIPII@ - a) @ -0), 
i=l j=l 

D4 = S04 —xi-1) Oj — yj-1)” < ||P — a) - 0). 
i=1 J=1 


Substituting these four results into (7.1.15) shows that 
I< S(P)<JI+|P||(®-—ad—-c), 


where 
(d —c)(b? — a”) + (b —a)(d? —c?) 
> 2 


I 


From this, we see that _ 
[e + y)d(x,y) =I. 
After substituting 
X-1+ yj = lta + xi-1) + (yj + Yj-1) — 0G — Xi-1) — (V7 — YF-)] 
into (7.1.14), a similar argument shows that 


1 —||P||(®—a)(d —c) <s(P) <I, 
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sO 


[etnden ar. a 
R 
We now prove an analog of Lemma 3.2.1. 


Lemma 7.1.6 Suppose that | f(X)| < M if X is in the rectangle 
R = [a1, by] x [a2, b2] x +++ x [an, dy]. 


Let P = P, x Pz x-++x Py and P'’ = P{ x P3 x---x P), be partitions of R, where P; 
is obtained by adding rj; partition points to P;, 1 < j <n. Then 


n 


S(P) > S(P’) => S(P) —2MV(R) Oe eer \| P| (7.1.16) 
j=l / J 
and 
s(P) <s(P’) <s(P) + 2MV(R) ers \|P). (117) 
a aid 


Proof We will prove (7.1.16) and leave the proof of (7.1.17) to you (Exercise 7.1.7). 
First suppose that P/ is obtained by adding one point to P;, and P i = P;for2<j <n. 
If P, is defined by 


Py dp = Gro < yp. < +++ < rm, = by, <r <n, 
then a typical subrectangle of P is of the form 
Ri jamin = Lai 1A] X (42, j2-1, 420] X +++ x [An jn-1, Anin]- 
Let c be the additional point introduced into P; to obtain P/, and suppose that 
Aik-1 <C < dig. 


If 71 Ak, then R;, j,..;, is common to P and P’, so the terms associated with it in S(P’) 
and S(P) cancel in the difference S(P) — S(P’). To analyze the terms that do not cancel, 


define 
(1) 
kjo-jn 
(2) 
kj2~jn 


= [a1,k—-1, c] x [d2,jo-1; a2 j>| Kr X [an,jn—1> Anjn|, 
= Ic, a1k| x [d2, j>—-1. a2 j>| Kr XK [an,jn—1 Anjn|s 
Mk jj, = Sup { f (X) |X © Rejo~ jn} (7.1.18) 


and 
My. in = sup {f(X) | xX € Bea 2 i = 1, 2s (7.1.19) 
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Then S(P) — S(P’) is the sum of terms of the form 


1 
X(d2j = a2, jo—1) aa (An jn — An, jn-1)- 


The terms within the brackets can be rewritten as 


(Mijn in — Mj... ;, (C= 41-1) + (Mein in — MQ... (Qik — 9), (71.21) 
which is nonnegative, because of (7.1.18) and (7.1.19). Therefore, 
S(P’) < S(P). (7.1.22) 


Moreover, the quantity in (7.1.21) is not greater than 2M(a1x —a1,¢~1), So (7.1.20) implies 
that the general surviving term in S(P) — S(P’) is not greater than 
2M || P||(@2j. — 42, j2-1) *** (Anjn — An, jn—-1)- 
The sum of these terms as jz, ..., jn assume all possible values 1 < jj < mj,2 <i <n, 
is 
2M||P\|V(R) 
2M IP Iba —a2)--- (bn — dn) = “PY 
1-4 

This implies that 
2M || P||V(R) 

by-ay 
This and (7.1.22) imply (7.1.16) forr; = 1 andrz =--- =r, = 0. 

Similarly, ifr; = 1 for somei in {1,...,n} andr; = Oif 7 #7, then 
2M || P||V(R) 

Db; —aj , 


S(P) < S(P) + 


S(P) < S(P’) + 


To obtain (7.1.16) in the general case, repeat this argument 7; + 72 +--+ +7, times, as in 
the proof of Lemma 3.2.1. 0 


Lemma 7.1.6 implies the following theorems and lemma, with proofs analogous to the 
proofs of their counterparts in Section 3.2. 


Theorem 7.1.7 If f is bounded ona rectangle R, then 
[ reoaxs [ rooax. 
JR R 


Proof Exercise 7.1.8. 


The next theorem is analogous to Theorem 3.2.3. 


Theorem 7.1.8 /f f is integrable on a rectangle R, then 
/ f(®%)dx = / f(&®)dxX = / f(%) dX. 
JR R R 


Proof Exercise 7.1.9. 
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Lemma 7.1.9 If f is bounded on a rectangle R and € > 0, there is a6 > 0 such that 


[ rooaxssie)<f roar. 
R R 
and 
| fooax=siPy> | roo ax- 
aa JR 


if ||P || <6. 


Proof Exercise 7.1.10. 


The next theorem is analogous to Theorem 3.2.5. 


Theorem 7.1.10 If f is bounded ona rectangle R and 


J fooax = [ sooax = 


then f is integrable on R, and 


[ fooax=t. 


Proof Exercise 7.1.11. 


Theorems 7.1.8 and 7.1.10 imply the following theorem, which is analogous to Theo- 
rem 3.2.6. 


Theorem 7.1.11 A bounded function f is integrable on a rectangle R if and only if 
/ f(&®)dxX = i F(X) dX. 
JR R 


The next theorem translates this into a test that can be conveniently applied. It is analo- 
gous to Theorem 3.2.7. 


Theorem 7.1.12 If f is bounded on a rectangle R, then f is integrable on R if and 
only if for every € > 0 there is a partition P of R such that 


S(P) —s(P) <e. 


Proof Exercise 7.1.12. 


Theorem 7.1.12 provides a useful criterion for integrability. The next theorem is an 
important application. It is analogous to Theorem 3.2.8. 


Theorem 7.1.13 If f is continuous ona rectangle R inR", then f is integrable on R. 
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Proof Let « > 0. Since f is uniformly continuous on R (Theorem 5.2.14), there is a 
5 > O such that 


Lf (X) — f(X)| < 7 (7.1.23) 


if X and X’ are in R and |K — X’| < 6. Let P = {Rj, Ro, ..., Ry} be a partition of R with 
|| P || < 6/./n. Since f is continuous on R, there are points X; and x) in R; such that 


f (Xj) =M; = sup f(X) and f(Xj) =m; = inf f(X) 
XeR; XeR; 


(Theorem 5.2.12). Therefore, 


S(P) — s(P) = DOF (Ks) — f(K))V(Rj). 


j=l 


Since || P|| < 6/./n, |X; —X’,| < 4, and, from (7.1.23) with X = X; and X’ = X’,, 


k 
€ 
S(P) —s(P) < —~ V(R;) =e. 
(P) —s@®) Vem (Rj) =¢ 
Hence, f is integrable on R, by Theorem 7.1.12. 


Sets with Zero Content 


The next definition will enable us to establish the existence of rp J (X) dX in cases where 
f is bounded on the rectangle R, but is not necessarily continuous for all X in R. 


Definition 7.1.14 A subset E of R” has zero content if for each € > 0 there is a finite 
set of rectangles T), 72, ..., Ty, such that 


m 
£e|\T, (7.1.24) 
j=l 
and 
m 
Y\V(Tj) <e. (7.1.25) 
j=1 


Example 7.1.3 Since the empty set is contained in every rectangle, the empty set has 
zero content. If £ consists of finitely many points X;, X2,..., Xm, then X; can be enclosed 
in arectangle 7; such that 


ViTj)<—, 1<j<m. 
. m 


Then (7.1.24) and (7.1.25) hold, so E has zero content. 
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Example 7.1.4 Any bounded set F with only finitely many limit points has zero con- 
tent. To see this, we first observe that if F has no limit points, then it must be finite, by the 
Bolzano—Weierstrass theorem (Theorem 1.3.8), and therefore must have zero content, by 
Example 7.1.3. Now suppose that the limit points of EF are X1, Xo, ..., Xm. Let Ri, Ro, 
..., Rm be rectangles such that X; € R° and 


V(Ri)<—, 1<i<m. (7.1.26) 
2m 


The set of points of F that are not in UFR j has no limit points (why?) and, being 
bounded, must be finite (again by the Bolzano—Weierstrass theorem). If this set contains p 
points, then it can be covered by rectangles R), R4,..., R, with 


V(R‘) < 7 l<j<p. (7.1.27) 


Now, 


and, from (7.1.26) and (7.1.27), 
m P 
a V(R;) + > V(R’,) <e. 
i=1 j=1 
Example 7.1.5 If f is continuous on [a, b], then the curve 
y= f(x) a<x<b (7.1.28) 


(that is, the set {a y) | y= f(x),a<x< b}), has zero content in R*. To see this, 
suppose that €« > 0, and choose 6 > 0 such that 


|f(x) — f(x)| <e if x,x’e[a,b] and |x—-x'| <6. (7.1.29) 
This is possible because f is uniformly continuous on [a, b] (Theorem 2.2.12). Let 
P:a=Xxo0 <X1 <+::<X, =) 
be a partition of [a, b] with || P || < 5, and choose 1, &, ..., &) so that 
MHiSGam, Jatan. 
Then, from (7.1.29), 
If) — fd) <e if x-1< x < x. 


This means that every point on the curve (7.1.28) above the interval [x;~1, x;] is in a rect- 
angle with area 2€(x; — x;-1) (Figure 7.1.4). Since the total area of these rectangles is 
2¢(b — a), the curve has zero content. 
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Figure 7.1.4 


The next lemma follows immediately from Definition 7.1.14. 
Lemma 7.1.15 The union of finitely many sets with zero content has zero content. 


The following theorem will enable us to define multiple integrals over more general 
subsets of R”. 


Theorem 7.1.16 Suppose that f is bounded on a rectangle 
R = [ay, by] x [a2, b2] x --+ x [an, bn] (7.1.30) 


and continuous except on a subset E of R with zero content. Then f is integrable on R. 


Proof Suppose that « > 0. Since E has zero content, there are rectangles T,, To, ..., 
Tm such that 


m 
BCT; (7.1.31) 
j=l 
and 
m 
> V(Tj) <e. (7.1.32) 
J=1 
We may assume that 7), 72, ..., Ti are contained in R, since, if not, their intersections 


with R would be contained in R, and still satisfy (7.1.31) and (7.1.32). We may also assume 
that if T is any rectangle such that 


m 
T (| (Jz? =@, thn TNE=90 (7.1.33) 
j=l 
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since if this were not so, we could make it so by enlarging 7), Tz, ..., Tim slightly while 
maintaining (7.1.32). Now suppose that 


Tj = [a1j. bij] x [a2j,b2j] x +++ x [anjsbnjl, LS i Sm, 
let Pio be the partition of [a;, bj] (see (7.1.30)) with partition points 
a;,b;, 4:1, bi1, Gi2, biz, .--, im, Dim 
(these are not in increasing order), | <i <n, and let 
Po = Pio X Poo X ++: X Pro. 


Then Po consists of rectangles whose union equals UF Tj and other rectangles T/, T3, 
..., T; that do not intersect E. (We need (7.1.33) to be sure that 77 E = @,1 <i <k.) 


If we let 
m k 
B= |)7; od C=|)7, 
j=l 


i=1 


then R = B UC and ff is continuous on the compact set C. If P = {R1, Ro,..., Re} is 
arefinement of Po, then every subrectangle R; of P is contained entirely in B or entirely 
in C. Therefore, we can write 


S(P) — s(P) = E1(Mj —mj)V(Rj) + Z2(Mj — mj)V(Rj), (7.1.34) 


where &; and X2 are summations over values of j for which R; C Band R; C C, 
respectively. Now suppose that 


|f(X)| <M for Xin R. 


Then 


m 
=1(M; —m;)V(Rj) < 2M X1V(Rj) =2M Y~ V(Tj) < 2Me, (7.1.35) 
j=l 


from (7.1.32). Since f is uniformly continuous on the compact set C (Theorem 5.2.14), 
there is ad > 0 such that M; —m; <e if ||P|| <6 and R; C C; hence, 


X2(M; = m;)V(R;) <éEXo2 V(R;) <eV(R). 
This, (7.1.34), and (7.1.35) imply that 
S(P) —s(P) < [2M + V(R)Je 


if ||P || < 6 and P is a refinement of Po. Therefore, Theorem 7.1.12 implies that f is 
integrable on R. q 
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Example 7.1.6 The function 
x+y, O<x<y<l, 
fy) = 
5, O<ysx<l, 
is continuous on R = [0, 1] x [0, 1] except on the line segment 


y=x, O<x<l 


(Figure 7.1.5). Since the line segment has zero content (Example 7.1.5), f is integrable on 
R. 


f@ y)=xty 


Figure 7.1.5 


Integrals over More General Subsets of R” 


We can now define the integral of a bounded function over more general subsets of R”. 


Definition 7.1.17 Suppose that f is bounded on a bounded subset of S of R”, and let 
f(X), XeES, 


X) = 
fs (X) . x5. 


(7.1.36) 


Let R be a rectangle containing S. Then the integral of f over S is defined to be 
[ feoax= | feooax 
Ss R 


if [ip fs(X) dX exists. | 
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To see that this definition makes sense, we must show that if R; and R> are two rect- 
angles containing S and Sr, fs (X) dX exists, then so does i Fs (X) dX, and the two 
integrals are equal. The proof of this is sketched in Exercise 7.1.27. 


Definition 7.1.18 If S is a bounded subset of R” and the integral /, dX (with inte- 
grand f = 1) exists, we call fs dX the content (also, area if n = 2 or volume ifn = 3) 
of S, and denote it by V(S); thus, 


V(S) = [ dX. 


Theorem 7.1.19 Suppose that f is bounded on a bounded set S and continuous ex- 
cept ona subset E of S with zero content. Suppose also that 0S has zero content. Then f 
is integrable on S. 


Proof Let fs beas in (7.1.36). Since a discontinuity of fs is either a discontinuity of f 
or a point of 0S, the set of discontinuities of fs is the union of two sets of zero content and 
therefore is of zero content (Lemma 7.1.15). Therefore, fs is integrable on any rectangle 
containing S (from Theorem 7.1.16), and consequently on S (Definition 7.1.17). an] 


Differentiable Surfaces 


Differentiable surfaces, defined as follows, form an important class of sets of zero content 
in R”. 


Definition 7.1.20 A differentiable surface S in R" (n > 1) is the image of a compact 
subset D of R”, where m < n, under a continuously differentiable transformation G : 
R” — R”. If m = 1, S is also called a differentiable curve. 


Example 7.1.7 The circle 
{(x, y) |x? + y? = 9} 


is a differentiable curve in R?, since it is the image of D = [0, 27] under the continuously 
differentiable transformation G : R — R? defined by 


x= 600) =| 30") |: 


3 sind 


Example 7.1.8 The sphere 
{(x,y,z) |x? +y7 +27 =4} 
is a differentiable surface in R?, since it is the image of 
D = {(6,¢)|0 < 0 < 2n,-n/2< $< 7x/2} 
under the continuously differentiable transformation G : R? — R? defined by 
2cos 6 cos @ 


X = G(O,¢) = | 2sinOcos¢ 
2sing 
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Example 7.1.9 The set 
{(x1, x2, x3, x4) [a7 = OG = 1,2,3,4), x1 +42 = 1, x3 +44 = 1} 


is a differentiable surface in R*, since it is the image of D = [0, 1] x [0, 1] under the 
continuously differentiable transformation G : R? — R* defined by 


X = G(u,v) = 


Theorem 7.1.21 A differentiable surface in R" has zero content. 


Proof Let S, D, and G be as in Definition 7.1.20. From Lemma 6.2.7, there is a 
constant M such that 


|G(X) — G(Y)| < M|X-—Y| if X,YeED. (7.1.37) 
Since D is bounded, D is contained in a cube 
C = [a1, 54] x [a2, b2] x +++ x [am, bm], 


where 
bj -—aj =L, 1<i<m. 


Suppose that we partition C into N” smaller cubes by partitioning each of the intervals 
[a;, bj] into N equal subintervals. Let R,, R2,..., Rx be the smaller cubes so produced that 
contain points of D, and select points X,, Xo, ..., X; such that X; € DN Rj, 1 <i <k. 
If Y ¢ DN R;, then (7.1.37) implies that 


|G(X;) — G(Y)| < M|X; —Y]. (7.1.38) 
Since X; and Y are both in the cube R; with edge length L/N, 
L 
|X; —Y| < pe 
N 


This and (7.1.38) imply that 


G(X) - G)| < sian 


which in turn implies that G(Y) lies in a cube R; in R” centered at G(X; ), with sides of 
length 2ML./m/N. Now 


k n n 
~ 2ML 2ML = 
Yo V(Ri) =k ease ki i aM. = QMLVm)"N™™", 
rae N N 
Since 1 > m, we can make the sum on the left arbitrarily small by taking N sufficiently 


large. Therefore, S has zero content. au) 


Theorems 7.1.19 and 7.1.21 imply the following theorem. 
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Theorem 7.1.22 Suppose that S is a bounded set in R" , with boundary consisting of 
a finite number of differentiable surfaces. Let f be bounded on S and continuous except 
on a set of zero content. Then f is integrable on S. 


Example 7.1.10 Let 
S= {(x,y) |x? +y? = 1, bea) or 


thus, S is bounded by a semicircle and a line segment (Figure 7.1.6), both differentiable 
curves in R?. Let 


6x9) (l—x?-y?)¥?, (@,y eS, y>0, 
x,y= 
—(l—x2-—y?)!/2, (x, y)eS, y <0. 
y y y 
Then f is continous on S except on the line segment 


y=0, O<x<l, 


which has zero content, from Example 7.1.5. Hence, Theorem 7.1.22 implies that f is 
integrable on S. 


Figure 7.1.6 


Properties of Multiple Integrals 


We now list some theorems on properties of multiple integrals. The proofs are similar to 
those of the analogous theorems in Section 3.3. 

Note: Because of Definition 7.1.17, if we say that a function f is integrable on a set S, 
then S is necessarily bounded. 
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Theorem 7.1.23 If f and g are integrable on S, then so is f + g, and 
fu + g)(X)dX = [ fH AX+ f gXaX. 


Proof Exercise 7.1.20. 


Theorem 7.1.24 If f is integrable on S and c is a constant, then cf is integrable on 
S, and 


[cneoax = cf F(X) dX. 
S S 
Proof Exercise 7.1.21. 
Theorem 7.1.25 If f and g are integrable on S and f(X) < g(X) for X in S, then 
[ tovaxe [ scoax. 
S S 
Proof Exercise 7.1.22. 


Theorem 7.1.26 If f is integrable on S, then so is | f |, and 


if F(X) dX 


< [ \foniax. 


Proof Exercise 7.1.23. 
Theorem 7.1.27 If f and g are integrable on S, then so is the product fg. 
Proof Exercise 7.1.24. 


Theorem 7.1.28 Suppose that u is continuous and v is integrable and nonnegative on 
a rectangle R. Then 


[ woop ax = (Xo) [ v(X)dX 
R R 
for some Xo in R. 


Proof Exercise 7.1.25. 


Lemma 7.1.29 Suppose that S is contained in a bounded set T and f is integrable 
on S. Then fs (see (7.1.36)) is integrable on T, and 


[ sooax= [ rooax. 


Proof From Definition 7.1.17 with f and S replaced by fs and T, 
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Gums ier soe 


Since S C T, (fs)r = fs. (Verify.) Now suppose that R is a rectangle containing T. 
Then R also contains S (Figure 7.1.7), 


Figure 7.1.7 
so 
i: f(X)dxX = i fs (X) dX (Definition 7.1.17, applied to f and S) 
= | (fer %aX (since (fs)r = fs) 
= [ fs (X) dX (Definition 7.1.17, applied to fs and T), 
which completes the proof. 0 


Theorem 7.1.30 /f f is integrable on disjoint sets S, and S2, then f is integrable on 
S; U So, and 


/ f(X)dX = / f(X)dX + / f(X) dX. (7.1.39) 
S$,US2 S1 So 
Proof Fori = 1, 2, let 
FS (8), XeE Si, 
fs;(X) " X dS). 


From Lemma 7.1.29 with S = S; and T = Sj U Sp, fs, is integrable on S; U Sz, and 


| fs,xyax = f f(X)dX, i =1,2. 
S,US2 S; 


Theorem 7.1.23 now implies that fs, + fs, is integrable on S; U Sz and 


i (fs, + fs,)(K) dX = / f(X)dX + i f(X) dX. (7.1.40) 
S,US. Sy So 
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Since S$; 1 Sz = @, 


(fs, oi fs) (X) = fis, (X) a Ss, (X) = f(K), XeS, US). 


Therefore, (7.1.40) implies (7.1.39). an 
We leave it to you to prove the following extension of Theorem 7.1.30. (Exercise 7.1.31(b)). 


Corollary 7.1.31 Suppose that f is integrable on sets S, and Sy such that S; N Sz 
has zero content. Then f is integrable on S, U Sz, and 


[fax =f, fopax+ J fooax 


Example 7.1.11 Let 


Si: ={@, y)|0<x<1,0<y<1+4x} 
and 


S2 = {(x,y)| -l<x<0,0<y<1-x} 
(Figure 7.1.8). 


| - 


Figure 7.1.8 
Then 
Si NS. ={0,y)|0<y <1} 


has zero content. Hence, Corollary 7.1.31 implies that if f is integrable on S; and S2, then 
f is also integrable over 


S=S,US, = {(@x,y)| -l<x<1,0<y<1+4|x}} 


(Figure 7.1.9), and 


Tse 1a [, feat | f(X) dX. 
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y Bf 


y=l+x 


Figure 7.1.9 


We will discuss this example further in the next section. 


7.1 Exercises 


Prove: If R is degenerate, then Definition 7.1.2 implies that fp f(X)dX = Oif f 
is bounded on R. 


Evaluate directly from Definition 7.1.2. 
(a) fgQx+2y)d(x,y); R= [0,2] x [1,3] 
(b) fpxyd(x,y); R=[0,1]x [0,1] 


Suppose that qe F(x) dx and fe g(y) dy exist, and let R = [a, b] x [c, d]. Criticize 
the following “proof” that ip Ft (x)g(y) d(x, y) exists and equals 


(i riya] (i (9) iv) | 


(See Exercise 7.1.30 for a correct proof of this assertion.) 
“Proof.” Let 


Py :ad=X0<xXy <-++<xX,=b and Pp:c=yo< yi <-:-<ys=d 


be partitions of [a, b] and [c, d], and P = P, x P2. Then a typical Riemann sum of 
fg over P is of the form 


a= >) > f&)g(nj ai — x11) (9) — yj—-1) = 1102, 
i=1 j=1 


where 


o1= >> fii —xi-1) and 02 = D> g(nj)(vj — Yj) 


i=1 j=l 
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15. 


are typical Riemann sums of f over [a,b] and g over [c,d]. Since f and g are 
integrable on these intervals, 


b d 
— / feiee| aad: lee i g(y) dy 


can be made arbitrarily small by taking || P;|| and || P2|| sufficiently small. From 
this, it is straightforward to show that 


o-([ rovas] (["srar) 


can be made arbitrarily small by taking ||P || sufficiently small. This implies the 
stated result. 


Suppose that f(x,y) => 0 on R = [a,b] x [c,d]. Justify the interpretation of 
Jp f(x. ¥) d(x, y), if it exists, as the volume of the region in IR? bounded by the 
surfaces z = f(x, y) and the planes z = 0,x =a,x =b,y=c,andy =d. 


Prove Theorem 7.1.5. HINT: See the proof of Theorem 3.1.4. 


Suppose that 
0 if x and y are rational, 
fl i 1 if x is rational and y is irrational, 
add = No if x is irrational and y is rational, 
3 if x and y are irrational. 
Find 


| fenaey and [ fe.naen if R=|o,b)x|[e,d]. 
R JR 


Prove Eqn. (7.1.17) of Lemma 7.1.6. 

Prove Theorem 7.1.7 HINT: See the proof of Theorem 3.2.2. 

Prove Theorem 7.1.8 HINT: See the proof of Theorem 3.2.3. 

Prove Lemma 7.1.9 HINT: See the proof of Lemma 3.2.4. 

Prove Theorem 7.1.10 HINT: See the proof of Theorem 3.2.5. 

Prove Theorem 7.1.12 HINT: See the proof of Theorem 3.2.7. 

Give an example of a denumerable set in R? that does not have zero content. 
Prove: 


(a) If S; and Sz have zero content, then S; U S> has zero content. 
(b) If S; has zero content and Sz C Sj, then S$» has zero content. 
(c) If S has zero content, then S has zero content. 


Show that a degenerate rectangle has zero content. 


16. 


17. 


18. 


19. 


20. 
21. 
22. 
23. 
24. 
25. 
26. 


27. 


28. 
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Suppose that f is continuous on a compact set S in R”. Show that the surface 
z = f(X), X € S, has zero content in R’*!. HINT: See Example 7.1.5. 


Let S be a bounded set such that S M 0S does not have zero content. 


(a) Suppose that f is defined on S and f(X) > p > 0 onasubset T of SN AS 
that does not have zero content. Show that f is not integrable on S. 


(b) Conclude that V(S) is undefined. 


(a) Suppose that h is bounded and h(X) = 0 except on a set of zero content. 
Show that f; h(X) dX = 0 for any bounded set S. 


(b) Suppose that f, f(X) dX exists, g is bounded on S, and f(X) = g(X) except 
for X ina set of zero content. Show that g is integrable on S and 


[smoax= [ rooax, 


Suppose that f is integrable on a set S and So is a subset of S such that 0So has 
zero content. Show that f is integrable on So. 


Prove Theorem 7.1.23 HINT: See the proof of Theorem 3.3.1. 
Prove Theorem 7.1.24. 
Prove Theorem 7.1.25 HINT: See the proof of Theorem 3.3.4. 
Prove Theorem 7.1.26 HINT: See the proof of Theorem 3.3.5. 
Prove Theorem 7.1.27 HINT: See the proof of Theorem 3.3.6. 
Prove Theorem 7.1.28 HINT: See the proof of Theorem 3.3.7. 


Prove: If f is integrable on a rectangle R, then f is integrable on any subrectangle 
of R. HINT: Use Theorem 7.1.12; see the proof of Theorem 3.3.8. 


Suppose that R and R are rectangles, R C R, g is bounded on R, and g(X) = Oif 
X ZR. 


(a) Show that fx g(X) dX exists if and only if fp g(X) dX exists and, in this 
case, 


[ecoax = | eomax. 


HINT: Use Exercise 7.1.26. 

(b) Use (a) to show that Definition 7.1.17 is legitimate; that is, the existence and 
value of s /(X) dX does not depend on the particular rectangle chosen to 
contain S. 


(a) Suppose that f is integrable on a rectangle R and P = {Rj, Ro,..., Rx} is 
a partition of R. Show that 


k 
[ fooax= d I, f (X) dX. 


HINT: Use Exercise 7.1.26. 


462 Chapter 7 Integrals of Functions of Several Variables 


(b) Use (a) to show that if f is continuous on R and P is a partition of R, then 
there is a Riemann sum of f over P that equals [, f(X) dX. 


29. Suppose that f is continuously differentiable on a rectangle R. Show that there is a 
constant M such that 


<M\|P\i 


oO i f(®&) dx 
R 
if o is any Riemann sum of f over a partition P of R. HINT: Use Exercise 7.1.28(b) 
and Theorem 5.4.5. 
30. Suppose that i? f(x) dx and i g(y) dy exist, and let R = [a, b] x [c, d]. 
(a) Use Theorems 3.2.7 and 7.1.12 to show that 


/ f@adce,y) and i; ey) d(x, y) 
R R 


both exist. 
b) Use Theorem 7.1.27 to prove that X d(x, y) exists. 
P R &Y y 
(c) Justify using the argument given in Exercise 7.1.3 to show that 


b d 
i resyeorate.0) =( | riya] ( i coe) 


31. (a) Suppose that f is integrable on S and So is obtained by removing a set of 
zero content from S. Show that f is integrable on So and /[ So F(X) dX = 


Ig f(X) dX. 
(b) Prove Corollary 7.1.31. 


7.2 ITERATED INTEGRALS AND MULTIPLE INTEGRALS 


Except for very simple examples, it is impractical to evaluate multiple integrals directly 
from Definitions 7.1.2 and 7.1.17. Fortunately, this can usually be accomplished by evalu- 
ating n successive ordinary integrals. To motivate the method, let us first assume that f is 
continuous on R = [a,b] x [c,d]. Then, for each y in [c,d], f(x, y) is continuous with 
respect to x on [a, b], so the integral 


b 
F(y) = / f(x,y) ax 


exists. Moreover, the uniform continuity of f on R implies that F is continuous (Exer- 
cise 7.2.3) and therefore integrable on [c, d]. We say that 


h -[ F(y) dy -[ ([' nes) dy 
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is an iterated integral of f over R. We will usually write it as 


n= fla f sonar 


Another iterated integral can be defined by writing 


d 
G(x) = | Ga Bene. 


b b d 
= | Goydx = f (/ fis. s)ay) dx, 
which we usually write as 
b d 
n= fax f fo.»ay. 


f(x, y)=x+y 


and defining 


Example 7.2.1 Let 


and R = (0, 1] x [1, 2]. Then 


1 


1 1 ro) 1 
Foy= ff fo.ndx=[o+ydr=(Ft)| 5+ 
0 0 2 x=0 2 
and 
° (1 y  »\/ 
h=] FO)dy=] (Z+y)dv=(5+7]| =2. 
1 / (y) dy [ Gr)e (F+5)] 
Also, 
: y?\ |? 1 3 
a= fw +dy= (xv +5) =0x42)-(x+5)=045, 
1 2 y=1 2 2 
and 


1 1 2 1 
3 x 3x 
n= | Gwax= | (»+3) tee ($+2) =o 
0 0 2 2 2) Io 
In this example, J; = J; moreover, on setting a = 0,b = 1,c = 1, andd = 2in 
Example 7.1.1, we see that 


[o+naey = 
R 


so the common value of the iterated integrals equals the multiple integral. The following 
theorem shows that this is not an accident. 
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Theorem 7.2.1 Suppose that f is integrable on R = [a,b] x [c, d] and 


b 
FQ) = / fa, nax 


exists for each y in [c,d]. Then F is integrable on [c, d|, and 


d 
/ F(y)dy = [ fe, y)d@, 9); (7.2.1) 
that is, 


d b 
/ dy / f(x. y)dx = [ fe. a, y). (7.2.2) 


Proof Let 
Py :a@=x9<xX1<-9++-< x, =b and Po:c=yo< yi <-:-< ys =a 


be partitions of [a, b] and [c, d], and P = P; x P2. Suppose that 


y-uxnj<yj;, ISj<s, (7.2.3) 
sO 
S 
o=)> F(nj\(yj —yj-1) (7.2.4) 
j=1 


is a typical Riemann sum of F over Pz. Since 
b r x 
Fay= fo foonax= Sf fonyax. 
a j=1  *i-1 
(7.2.3) implies that if 


my = int (f(y) | si S * 3 on, Vp = ¥ = 97} 
and 
Mi = sup { f(x, y) | xi-1 < ¥ < Mi, Vj-1 Sy < ys}, 
then 


So mij (i —Xj-1) < F(nj) S So Mi (i — Xj-1). 


i=1 i=1 


Multiplying this by y; — yj; and summing from j = 1 to j = s yields 


de mi — 1-05 — ¥j-1) S DY FO)Os — yi-1) 


j=li=l j=l 


< a So Mi i — xi-1)(¥j — Yj-1), 


j=li=i 


Section 7.2 Iterated Integrals and Multiple Integrals 465 


which, from (7.2.4), can be rewritten as 
se(P) <0 < Sf(P), (7.2.5) 


where s ¢(P) and S¢(P) are the lower and upper sums of f over P. Now let s7(P2) and 
SF (P2) be the lower and upper sums of F over P2; since they are respectively the infimum 
and supremum of the Riemann sums of F over P2 (Theorem 3.1.4), (7.2.5) implies that 


s¢(P) <sr(P2) < Sr(P2) < S¢(P). (7.2.6) 


Since f is integrable on R, there is for each € > 0 a partition P of R such that S ¢(P) — 
s¢(P) < ¢, from Theorem 7.1.12. Consequently, from (7.2.6), there is a partition P2 of 
[c, d] such that Sr (P2) — s7(P2) < €, so F is integrable on [c, d], from Theorem 3.2.7. 


It remains to verify (7.2.1). From (7.2.4) and the definition of : F(y) dy, there is for 
each € > 0aé > 0 such that 


d 
[ Foray -o <e if |[Pal| <6: 


c 


that is, 
d 
O-€ <| Fiy)dy<ot+e if ||Poll <6. 
c 
This and (7.2.5) imply that 
d 
sf(P)-e< / F(y)dy < Ss(P) +e if ||P <6, 
c 
and this implies that 
d —_ 
[ fendey-es fronds | tondey+e 729 
ve c 
(Definition 7.1.4). Since 
[ fe.naey =f fo.naen 
JR R 
(Theorem 7.1.8) and € can be made arbitrarily small, (7.2.7) implies (7.2.1). an] 


If f is continuous on R, then f satisfies the hypotheses of Theorem 7.2.1 (Exercise 7.2.3), 
so (7.2.2) is valid in this case. 


If fe F(x, y) d(x, y) and 


d 
/ feydy, eax ss, 
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exist, then by interchanging x and y in Theorem 7.2.1, we see that 


b d 
[ax fenar=f rondo. 
a c R 
This and (7.2.2) yield the following corollary of Theorem 7.2.1. 


Corollary 7.2.2 If f is integrable on [a,b] x [c,d], then 


[af rena= fia f senax 


provided that [4 I(x, y) dy exists fora <x <b and {? f(x, y) dx exists fore < y <d. 
In particular, these hypotheses hold if f is continuous on [a, b] x [c, d]. 


Example 7.2.2 The function 


f(x, y)=x+y 


is continuous everywhere, so (7.2.2) holds for every rectangle R. For example, let R = 
[0, 1] x [1, 2]. Then (7.2.2) yields 
1 
dy 
x=0 


2 1 2[ 32 
[o+naey -| ay | (x + y) dx = (+++) 
R 1 0 1 2 
2 2\ /2 
i ae 
I (a+)@=(+5) 

Since f also satisfies the hypotheses of Theorem 7.2.1 with x and y interchanged, we 
can calculate the double integral from the iterated integral in which the integrations are 
performed in the opposite order; thus, 
2 
dx 
y=1 


_ 1 2 o 1 y* 
[e+naan= fax fw+na =f (w+) 
: 3 ax | 

=f (s+3) @=(F+3) 


1 


= 2: 
0 


A plausible partial converse of Theorem 7.2.1 would be that if “a dy f. ? F(x, y)dx 
exists then so does hf R F(x, y) d(x, y); however, the next example shows that this need not 
be so. 


Example 7.2.3 If f is defined on R = [0, 1] x [0, 1] by 


2xy_ if y is rational, 
y if y is irrational, 


fy = 
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then Fi 
/ f@ydx=y, OSy<1, 
0 
and 
1 1 1 I 
i ay | F(x, y) dx = Le ae 
0 0 0 
However, f is not integrable on R (Exercise 7.2.7). | 


The next theorem generalizes Theorem 7.2.1 to R”. 


Theorem 7.2.3 Let I,, In,..., In be closed intervals and suppose that f is integrable 
on R = I, x Iy X-++X In. Suppose that there is an integer p in {1,2,...,n —1} such that 
Fy (pti, Xp425+++5 Xn) = / S(%1,X2,..-,Xn) d(x1, X2,...,Xp) 

I, XInxxIp 
exists for each (Xp41,Xp42,---,Xn) in [p41 X [p42 X +++ xX In. Then 


i Fy (Xp4i.Xpt2s---+Xn) A(X p41, Xp42,---,Xn) 
Tp41XIp42%xIn 


exists and equals |p f (X) dX. 


Proof For convenience, denote (x p41, Xp+42,..-,Xn) by Y. Denote R= I, x Ip X+++x 
Ip and T = Ip41 X [p42 X-++X In. Let P = {R1, Ro, ..., Ry} and Q = {T1, To,...,Ts} 
be partitions of R and T,, respectively. Then the collection of rectangles of the form R; x T; 
(1 <i <k,1</j <-s)isa partition P of R; moreover, every partition P of R is of this 
form. 


Suppose that 
¥,eT;, Lsy ss, (7.2.8) 
SO 
S 
o =) > F,(¥;)V(Tj) (7.2.9) 
j=l 


is a typical Riemann sum of F,, over Q. Since 


F,(Y¥j) = fo Plea xp Yale 3p) 
R 


k 
= ark SF (41, X2,.-.,Xp, Yj) d(%1, X2,...,Xp), 
joie’ 


J 


(7.2.8) implies that if 
mij = inf { f(r, x2,...,xp¥) | (%1,%X2,...,Xp) € Ri. Ye Tt 


and 
Mi; = sup { fer, x2,.-., Xp, ¥)| (1 ¥2,---s Xp) E Ri. Ye T;} 
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then 
k k 
S- mijV(Ri) < F(X) < D> Mi V(Ri). 
i=1 i=l 


Multiplying this by V(7;) and summing from j = 1 to 7 = s yields 


Ss k Ss Ss k 
Yo domi V(RIV(T;) < Yo F(X A)V(T;) < D> DS My V(Ri)V(T)), 
J=1 


J=1i=1 j=1i=1 


which, from (7.2.9), can be rewritten as 
s¢(P) <0 < Sf (P), (7.2.10) 


where s ¢(P) and S(P) are the lower and upper sums of f over P. Now let sr, (Q) and 
S,,(Q) be the lower and upper sums of Fp over Q; since they are respectively the infimum 
and supremum of the Riemann sums of F, over Q (Theorem 7.1.5), (7.2.10) implies that 


s¢(P) < 5F,(Q) < Sr, (Q) < S¢(P). (7.2.11) 


Since f is integrable on R, there is for each € > 0 a partition P of R such that S¢(P) — 
s¢(P) < €, from Theorem 7.1.12. Consequently, from (7.2.11), there is a partition Q of T 
such that Sr, (Q) — sr, (Q) < €, so Fp is integrable on T, from Theorem 7.1.12. 


It remains to verify that 
i fo dx = f F,(Y) dY. (7.2.12) 
R T 
From (7.2.9) and the definition of Ir F,(¥) dY, there is for each € > 0a 6d > O such that 


if F,(Y)dY—o|<e if ||Q\| <6: 
T 


that is, 
o-e<| Fav <o+e if ||Q\| <6. 
T 


This and (7.2.10) imply that 
s¢(P) -e< i, F,(Y)dY < S¢(P) +e if (P| <5, 
T 


and this implies that 


[ fooax-e= [ FoMAY < f f&%dX +e (7.2.13) 
JR T R 


Since i: f(X)dx = / F(X) dX (Theorem 7.1.8) and € can be made arbitrarily small, 
JR R 
(7.2.13) implies (7.2.12). an 
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Theorem 7.2.4 Let 1; = [a;,b;], 1 < j <n, and suppose that f is integrable on 
R= I, Xx Ip X-++x I. Suppose also that the integrals 


Fy (Xp4i,--+sXn) >i S(®) d(x1,X2,...,Xp), 1s p<n-l, 
I, XIg~xIp 


exist for all 
(Xptis---5Xn) in [py X+++X In. 


Then the iterated integral 


bn bn-1 bo by 
ij dx, f aXn-1 -f dx2 f(®) dx, 
an an-1 a2 a) 


exists and equals [p f(X) dX. 


Proof The proof is by induction. From Theorem 7.2.1, the proposition is true for n = 2. 
Now assume n > 2 and the proposition is true with n replaced by n — 1. Holding x, fixed 
and applying this assumption yields 


bn-1 bn-2 bo by 
Fy(Xn) =f dna f dina [ dx2 f(®) dx. 
a2 a 


an-1 an-2 1 


Now Theorem 7.2.3 with p = n — 1 completes the induction. 0 
Example 7.2.4 Let R = [0, 1] x [1,2] x [0, 1] and 


Sf yz=xtyt+z. 


Then 
1 x2 1 
Av.2= (ty tads= (5 +xy +22) =—+y+z, 
0 a 
2 2 1 
Fe) = | Fiy.z)dy = f (S+y+5] dy 
1 1 
2 2 
Vio ay. 
= v4 ys) =2+42, 
(3 2 os 
and 
' ' z\|* 5 
[ feradey.2= | Fr(z)dz = [ @+2de = (2+) =. 
R 0 0 2) \o9 2 


The hypotheses of Theorems 7.2.3 and 7.2.4 are stated so as to justify successive in- 
tegrations with respect to x,, then x2, then x3, and so forth. It is legitimate to use other 
orders of integration if the hypotheses are adjusted accordingly. For example, suppose that 
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{i1,i2,...,i,} is a permutation of {1,2,...,} and Te F(X) dX exists, along with 
/ TRG hee), 1Le7 Sn=1, (7.2.14) 
Ti, XTigX XTi ; . 


for each 


(Nise Nipagsd st Sie) in Tijay x Tijas Xe x Tj (7.2.15) 


Then, by renaming the variables, we infer from Theorem 7.2.4 that 


bin bi, biz bi, 
/ F(%) dX= dXi, / dXi,_, f din f F(%) dXi,. (7.2.16) 
R Qin a Gin ai, 


n-1 


Since there are m! permutations of {1,2,...,7}, there are n! ways of evaluating a mul- 
tiple integral over a rectangle in R”, provided that the integrand satisfies appropriate hy- 
potheses. In particular, if f is continuous on R and {i1,i2,...,in} is any permutation of 
{1,2,...,m}, then f is continuous with respect to (xj,,Xi2,.--,xi,) on Ti, X Tig XK Ui, 
for each fixed (Ri piy Mijpzareees X;,,) Satisfying (7.2.15). Therefore, the integrals (7.2.14) 
exist for every permutation of {1,2,...,2} (Theorem 7.1.13). We summarize this in the 
next theorem, which now follows from Theorem 7.2.4. 


Theorem 7.2.5 /f f is continuous on 
R = [a1, bi] x [a2, bz] x +++ x [an, dn], 
then de F(X) dX can be evaluated by iterated integrals in any of the n! ways indicated in 


216). 


Example 7.2.5 If f is continuous on R = [a1, 4] x [a2, ba] x [as, bs], then 


b3 bo by 
[ fer.2de.y.2)= f az | dy f(x, y,z) dx 
a3 ad a 


1 


bo b3 by 
-|/ ay | del fog oa 
ar a3 ay 


b3 b bo 

=| az | dx Sx, y,z) dy 
a3 a\ a2 
by b3 bo 

-/ ax [ dz | flx.y.z)dy 


1 


1 3 a2 
bo by b3 
=f ay | del” feed 
a a a3 


2 1 
by bo b3 
= i dx / dy | fly 2vde. 


2, a3 
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Integrals over More General Sets 


We now consider the problem of evaluating multiple integrals over more general sets. First, 
suppose that f is integrable on a set of the form 
S = {(x,y)|uQy) <x <Q), c< y <d} G27) 


(Figure 7.2.1). 
If u(y) > a and v(y) <b forc < y < d, and 
f@.y), Gy) €S, 


; = 7.2.18 
fs (x,y) I. (9) £5. ( ) 


then 


[tendon =f fede. 
Ss R 
where R = [a, b] x [c, d].. From Theorem 7.2.1, 


[ f@.nae.» = fof f(x, y)dx 


provided that iis F(x, y) dx exists for each y in [c,d]. From (7.2.17) and (7.2.18), this 


integral can be written as 
vy) 


f(x, y) dx. (7.2.19) 
) 


u(y 
Thus, we have proved the following theorem. 


Figure 7.2.1 


Theorem 7.2.6 /f f is integrable on the set S in (7.2.17) and the integral (7.2.19) 
exists forc < y <d, then 


d v(y) 
[ fenae» =| ay | f(x, y)dx. (7.2.20) 
Ss c u(y) 
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From Theorem 7.1.22, the assumptions of Theorem 7.2.6 are satisfied if f is continuous 
on § and u and v are continuously differentiable on [c, d]. 


Interchanging x and y in Theorem 7.2.6 shows that if f is integrable on 
S ={(x,y)|u@) sy < v(x), asx <b} (7.2.21) 


(Figure 7.2.2) and 
v(x) 
f(x, y) dy 
u(x) 


exists fora < x < b, then 


b v(x) 
[tena f dx . f(x, y) dy. (72.97) 
y 
A 
y=v(x) 
y=u(x) | 
' | > x 
a b 


Figure 7.2.2 


Example 7.2.6 Suppose that 


S(x,y) = xy 


and S is the region bounded by the curves x = y? and x = y (Figure 7.2.3). Since S can 
be represented in the form (7.2.17) as 


S={@,9)|y? <x Sy, 0< y= I}, 


1 y 
[» d(x, y) =| ay | xy dx, 
S 0 y2 


which, incidentally, can be written as 


1 y 
[ovaen = | yay f xdx, 
S 0 y2 


(7.2.20) yields 
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since y is independent of x. Evaluating the iterated integral yields 


1 x2 y 1 1 ‘ : 
[vans os yay=5 fo —y)dy 
S 0 y2 0 
1fy* yé® , _ il 
~2\4 6), 24 
y 
A 
x= 
d, 1) 
> x 
Figure 7.2.3 
In this case we can also represent S in the form (7.2.21) as 
S={@y|zeyv=ev%, 05% <1}: 
hence, from (7.2.22), 
1 x 1 y2 Vx 
[vac = x dx ydy =f — x dx 
(0) x 0 2 y=x 
ee lie ool A 
=; [ -x)ax=5 Pee =— 
2 2\3 4] \o 24 


Example 7.2.7 To evaluate 


/ (x+y) de, 9), 
S 


where 
S = {(x,y)| -l<x<1,0<y<1+4|x]} 
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(see Example 7.1.11 and Figure 7.2.4), 


mx 


Figure 7.2.4 


we invoke Corollary 7.1.31 and write 


[etna | (+ racy + f (c+ yd, 9), 
S Sy So 


where 
S,={(@, y)|0<x<1,0<y<1+x} 
and 
So = {(x, y) | —-1<x <0, O0<y<1-x} 
(Figure 7.2.5). 


From Theorem 7.2.6, 


a 1 1+x _ 1 (x + y)? 1+x 
[etna | axf w+ydy= | eo dx 
1 
-;/ [(2x + 1)? — x7] dx 
0 
_1f@x+) 3 x3 — 
-;|"--5| ere 
and 
_ 0 1-x _ 0 e+ 7? 1-x 
[ernden= fax | (+ ydy =f a - dx 
1 0 1 3 0 
=> 0-)ax=5(x-4) = 
= -1 


Therefore, 
7 


1 
[e+ ae.y =245= 3. 


Section 7.2 Iterated Integrals and Multiple Integrals 475 


y y 


Figure 7.2.5 


Example 7.2.8 To find the area A of the region bounded by the curves 
y=x?4+1 and y=9-x? 


(Figure 7.2.6), we evaluate 
A =) d(x, y), 
S 


S = {(x,y)|x?7+1<y <9-x?,-2<x <2}. 


where 


According to Theorem 7.2.6, 


a= fia f a= f [(9 — x2) - (x? + 1)] dx 


241 —2 


2 
=f (8 — 2x?) dx — (s--=) 
_2 3 = 


Figure 7.2.6 
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Theorem 7.2.6 has an analog forn > 2. Suppose that f is integrable on a set S of points 
X = (x1, X2,...,Xn) satisfying the inequalities 


Uj(Xj41,---.Xn) SX; < uj(Xj41,---,%n), 1l<j <n-l, 


and 
An < Xn < bn. 


Then, under appropriate additional assumptions, it can be shown by an argument analogous 
to the one that led to Theorem 7.2.6 that 


bn un (xn) V2(X3 5.5 xn) 01 (X2,...,.%n) 
i) foxydx = | dx f dna f dxa [ f(®) dx. 
Ss an Un(xn) u2(x3 xn) ui (x2 Xn) 


senXn) ASU] (XD,..., 


These additional assumptions are tedious to state for general n. The following theorem 
contains a complete statement forn = 3. 


Theorem 7.2.7 Suppose that f is integrable on 
S={@,y,2|m0.z) <x <1(),2), we) < y < (Z), ez <4}, 
and let 


S(z) = {(@x, y)|wiQ,z) <x <v1(y,2), u2(z) < y < va(z} 
for each z in|c,d]. Then 


d v2(z) v1 (9,2) 
[ feny.dde,¥.2 =i az | ay | I, y,z) dx, 
S c u u 


2(z) 1(9,2) 


provided that 
v1.2) 
f° feroasx 
u 


102) 
exists for all (y, z) such that 


Cc 


A 


z<d and u2(z) < y < v2(2), 
and 


/ fry. z(x,y) 
S(z) 


exists for all z in [c,d]. 


Example 7.2.9 Suppose that f is continuous on the region S in R* bounded by the 
coordinate planes and the plane 
x+y+2z=2 


(Figure 7.2.7); thus, 


Section 7.2 Iterated Integrals and Multiple Integrals 477 


Zz 


x+y+2z=1 


Figure 7.2.7 


S ={(x,y,z)|O<x <2-y—2z,0<y <2-2z,0<z<]}. 
From Theorem 7.2.7, 


[tere d(x, y,z) = [ dz [- dy —_ F(x, y,z) dx. 


There are five other iterated integrals that equal the multiple integral. We leave it to you 
to verify that 


2 1-y/2 2-—y—2z 
[fev2aey2= f ay [ az [ ets: 


1 2=—22 2-x—2z 
-| az | ax [ T(x, y,z) dy 
0 0 0 
2 1—x/2 2—-x—2z 
=i ax [ az | St (x,y,z) dy 
0 0 0 
2 2-x 1—x/2-—y/2 
-| ax [ ay | F(x, y,z)dz 
0 0 0 


2 2-y 1—x/2-y/2 
= | ay | ax [ f(x, y,z) dz a 
0 0 0 


Thus far we have viewed the iterated integral as a tool for evaluating multiple integrals. 
In some problems the iterated integral is itself the object of interest. In this case a result 


(Exercise 7.2.15). 
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like Theorem 7.2.6 can be used to evaluate the iterated integral. The procedure is as follows. 


(a) Express the given iterated integral as a multiple integral, and check to see that the 
multiple integral exists. 


(b) Look for another iterated integral that equals the multiple integral and is easier to 
evaluate than the given one. The two iterated integrals must be equal, by Theo- 
rem 7.2.6. 


This procedure is called changing the order of integration of an iterated integral. 


Example 7.2.10 The iterated integral 


1 y 5 
I = | ay | e Po dx 
0 0 


: 2 eran ; 
is hard to evaluate because e~*~-) has no elementary antiderivative. The set of points 
(x, y) that enter into the integration, which we call the region of integration, is 


S={(x,y)|O<x<y,0<y<1} 


(Figure 7.2.8). 


Figure 7.2.8 


Therefore, 
r= fee? ae, y), (75.93) 
S 


and this multiple integral exists because its integrand is continuous. Since S can also be 


written as 
S={(x,y)|x<y<1,0<x<}}, 
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Theorem 7.2.6 implies that 


1 1 1 
/ eG)? d(x, y) = i ae | dy = -| (x — leP-Y? dx 
S 0 x 0 


1 
= —(1-e74). 
ne 


1 
1 -@-yP 
2 


This and (7.2.23) imply that 


1 
I =-=(1-e7!). 
5 e°) 


Example 7.2.11 Suppose that f is continuous on [a, co) and y satisfies the differen- 
tial equation 
y"(x) = f(x), x>a, (7.2.24) 


with initial conditions 
y(a) = y'(a) = 0. 
Integrating (7.2.24) yields 


y'@) = / f(tdt, 


since y’(a) = 0. Integrating this yields 


yoy = [as f° reat. 


since y(a) = 0. This can be reduced to a single integral as follows. Since the function 
g(s.t) = fl) 
is continuous for all (s,¢) such that t > a, g is integrable on 
S={(,)|a<t<s, a et 
(Figure 7.2.9), and Theorem 7.2.6 implies that 
x Ss 
/ f(t) d(s,t) = / as [ f(t) dt = y(x). (7.2.25) 
S a a 
However, S can also be described as 
8 ={6,)|faeex,a st =x} 


so Theorem 7.2.6 implies that 


[roan = | soar | as =f (x —t) f(t) dt. 
Comparing this with (7.2.25) yields 


yoo) = f =n fdr, 
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A 


Figure 7.2.9 


7.2 Exercises 


1. Evaluate 


(a) [oferta (b) fax Poesroa 


20 2 log2 1 > 
(c) xdx [ sinxy dy (a) [ yay | xe*~ %dx 
1 0 0 


m/2 


2. Let; = [a;,6;],1 < j <3, and suppose that f is integrable on R = Jy x Iz x Is. 
Prove: 


(a) If the integral 


by 
G(y,z) = S(x,y, Zz) dx 


a 


exists for (y, z) € [2 x 13, then G is integrable on Jy x /3 and 


[ feradesa= f G(y, z) d(y, 2). 
R InxI3 


(b) If the integral 
He=f  foyz)deey) 
I, xIn 
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exists for z € /3, then H is integrable on /3 and 


b3 
[ ferodeso= | H(z) dz. 
R as 


HINT: For both parts, see the proof of Theorem 7.2.1. 


Prove: If f is continuous on [a, b] x [c, d], then the function 


b 
F(y) = / fle, dx 


is continuous on [c, d]. HINT: Use Theorem 5.2.14. 


Suppose that 
fa. y)= fy) if a<x<x'<bc<y<y' <d. 


Show that f satisfies the hypotheses of Theorem 7.2.1 on R = [a, b] x[c, d]. HINT: 
See the proof of Theorem 3.2.9. 


Evaluate by means of iterated integrals: 


(a) [or + dae rr R= (0.1]x [1.2] 
(b) [ex +3de.n R= [1,3] x [1,2] 


AY . = 
(c) Leto R= [0, 1] x [0, 1] 
(d) fpxcosxycos2xxd(x,y); R= [0,4] x [0,27] 


Let A be the set of points of the form (2~” p, 2~"q), where p and q are odd integers 
and m is a nonnegative integer. Let 


1, (x,y) ¢A, 


#9) = : (x,y eA. 


Show that f is not integrable on any rectangle R = [a, b] x [c,d], but 


[of feendy= [oar feonray = (b —a)(d —c). (A) 


HINT: For (A), use Theorem 3.5.6 and Exercise 3.5.6. 


Let 
2xy if y is rational, 
y if y is irrational, 


fle.y) =| 


and R = [0, 1] x [0, 1] (Example 7.2.3). 
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10. 


11. 
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(a) Calculate Irf@, y) d(x, y) and (ice y) d(x, y), and show that f is not 
integrable on R. 


(b) Calculate i (fof. y) dy) dx and i (ate: y) dy) dx. 


Let R = [0, 1] x [0, 1] x (0, 1], R = [0, 1] x [0, 1], and 


2xy + 2xz if y and z are rational, 


46 ye yt2xz if y is irrational and z is rational, 
ae Axy+zZ if y is rational and z is irrational, 
yz if y and z are irrational. 
Calculate 


(a) [ fear. ddey.2) and f fls.y.2)dl. 9.2) 


(b) [feny.ode.y and [feny.2dee.y 


(c) [af soy cracand fide fa [ reoy2ae 


Suppose that f is bounded on R = [a, b] x [c, d]. Prove: 
b d 
(a) i f(x, y) d(x, y) < / (/ f(x,y) iv) dx. HINT: Use Exercise 3.2.6(a). 
YR va_\Ye_ 


Ty “ab ( pd 
(b) [ fon d(x, y) =) (/ f(x,y) i) dx. HINT: Use Exercise 3.2.6(b). 


Use Exercise 7.2.9 to prove the following generalization of Theorem 7.2.1: If f is 
integrable on R = [a,b] x [c, d], then 


“Tb d 
/ fx.y)dy and / f(x,y) dy 


are integrable on [a, b], and 


[ (ii a= fo (Zic dx =f f(.y)dts.9) 


Evaluate 


(a) / (x —2y + 3z) d(x, y,z); R= [-2,0] x [2,5] x [-3, 2] 
R 

(b) i e* -)” sin x sinz d(x,y,z); R=[-1,1]x [0,2] x [0, z/2] 
R 


(c) [oy + 2x2 + yaa y.2) R = [-1, 1] x (0, 1] x [-1, 1] 


12. 


13. 


14. 


15. 


16. 


17. 


18. 
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(d) i x2 y3zexre d(x,y,z); R= [0,1] x [0,1] x [0,1] 
R 
Evaluate 


(a) fex+s ae.» S = {(x,y)|O<x<9-y?,-3<y <3} 


b 2xyd Xx, ); S is bounded b = x? and x = 2 
Ss 


(c) / ery d(x,y); S= {(x, y) | logy <x <log2y, m/2<y <x} 
S y 
Evaluate Ig + y)d(x, y), where S is bounded by y = x? and y = 2x, using 
iterated integrals of both possible types. 
Find the area of the set bounded by the given curves. 
(a) y=x74+9,y=x?-9,x=-l1x=1 
(b) y=x4+2,y=4-x,x =0 
(c) x=y?-4,x=4-y? 
(d) y=e*, y=-2x,x% =3 


In Example 7.2.9, verify the last five representations of [, f(x, y,z) d(x, y,Z) as 
iterated integrals. 


Let S be the region in R* bounded by the coordinate planes and the plane x + 
2y + 3z = 1. Let f be continuous on S. Set up six iterated integrals that equal 


Is I(x, ys Zz) d(x, y> Z). 


Evaluate 


(a) / x d(x,¥,z); S is bounded by the coordinate planes and the plane 
Ss 


3x +y+z=2. 


(b) [ vetdeey.2k 8 = {@,y,z)|O<x<1,0<y< Vx,0<z<y?} 
S 


(c) [ove d(x, y,Z); 
Ss 
S=\@y.2|0sy <1 0<x<JI-w0<z25 YP +y\ 


(d) [ xcdeay.2i8 = {7.02 sx 5 Vz. O<y<z,0<z<1]} 
S 


Find the volume of S. 

(a) S is bounded by the surfaces z = x” + y? and z = 8— x? — y?. 

(b) S = {(x,y,z)|0<z < x74 y?, (x, y, 0) is in the triangle with vertices 
(0, 1,0), (0, 0, 0), and (1, 0, 0)} 

(c) S={@,y,.z)|O<y <x?,05x<2,0<z < 77} 

(d) S={(x,y,z)|x=0, y>=0,0< 72 <4—4x? —4y?} 
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19. Let R = [a1, b2] x [a2, bo] x +--+ X [an, by]. Evaluate 
(a) fp 1 + x2 + +++ +n) dX (b) fp (xi tx3 +--+ + x2) dX 


(c) fp X1X2,°++Xn dX 
20. Assuming that f is continuous, express 


1 a/1—y2 
dy [ __ fs. y)dx 
| /2 —/1—y2 
as an iterated integral with the order of integration reversed. 


21. Evaluate f,(x+y) d(x, y) of Example 7.2.7 by means of iterated integrals in which 
the first integration is with = to x. 


22. Evaluate vas 
SS + y? 


23. Suppose that f is continuous on [a, oo), 
yYP@)=f@), t24, 


and y(a) = y'(a) =--- = y®-Y@ =0. 
(a) Integrate repeatedly to show that 


yoy = | “dt, i ies / ” ata "Fd. (A) 


(b) By successive reversals of orders of integration as in Example 7.2.11, deduce 
from (A) that 


yo) = A fo tyodr, 
24. Let T, = [0, p] x [0, p], p > 0. i calculating 
I(a) = lim / e *” sinax d(x, y) 
poo Jr, 


in two different ways, show that 


ei 
/ ee pee if a>O. 
0 XxX 2 


7.3 CHANGE OF VARIABLES IN MULTIPLE INTEGRALS 


In Section 3.3 we saw that a change of variables may simplify the evaluation of an ordinary 
integral. We now consider change of variables in multiple integrals. 
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Prior to formulating the rule for change of variables, we must deal with some rather 
involved preliminary considerations. 


Jordan Measurable Sets 


In Section we defined the content of a set S to be 
V(S) = / dx (7.3.1) 
S 


if the integral exists. If R is a rectangle containing S, then (7.3.1) can be rewritten as 


vis) = f vsaax, 
R 
where ws is the characteristic function of S, defined by 


vs(X) = 7 cos 


From Exercise 7.1.27, the existence and value of V(S) do not depend on the particular 
choice of the enclosing rectangle R. We say that S' is Jordan measurable if V(S) exists. 
Then V(S) is the Jordan content of S. 


We leave it to you (Exercise 7.3.2) to show that S has zero content according to Defini- 
tion 7.1.14 if and only if S has Jordan content zero. 


Theorem 7.3.1 A bounded set S is Jordan measurable if and only if the boundary of 
S has zero content. 


Proof Let R be a rectangle containing S. Suppose that V(AS) = 0. Since Wg is 
bounded on R and discontinuous only on 0S (Exercise 2.2.9), Theorem 7.1.19 implies that 
if R VS (X) dX exists. For the converse, suppose that 0S does not have zero content and 
let P = {Rj, Ro,..., Ry} be a partition of R. For each 7 in {1,2,...,k} there are three 
possibilities: 


1. Rj CS; then 
min {ys (X) |X € Rj} = max {ps(X)|X eR} = 1. 
2. Rj; NS #Band Rj 1 S° ZG; then 
min {Ws (X)|X¢ Rj} =O and max {Ws(X)|X€ Rj} =1. 
3. R; C S°; then 


min {Ws (X) |X €¢ Rj} = max {Ws(X)|X € Rj} =0. 
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Let 
U={j|R; CS} and Uz={j|RJNS AGBand Ri NS° AB}. (7.3.2) 


Then the upper and lower sums of wg over P are 


S(P)= D> V(Rj) + D> V(R)) 
Jeu jeuy (7.3.3) 
= total content of the subrectangles in P that intersect S 


and 
s(P)= )° V(Rj) 
Jeur (7.3.4) 
= total content of the subrectangles in P contained in S. 
Therefore, 


S(P)-s(P)= >> V(R;), 
Jeg 
which is the total content of the subrectangles in P that intersect both S and S°. Since 
these subrectangles contain 0S, which does not have zero content, there is an €9 > 0 such 
that 
S(P) —s(P) = €0 


for every partition P of R. By Theorem 7.1.12, this implies that Ws is not integrable on R, 
so S is not Jordan measurable. q 


Theorems 7.1.19 and 7.3.1 imply the following corollary. 


Corollary 7.3.2 If f is bounded and continuous on a bounded Jordan measurable set 
S, then f is integrable on S. 


Lemma 7.3.3 Suppose that K is a bounded set with zero content and €, p > 0. Then 
there are cubes Cy, Cz, ..., C; with edge lengths < p such thatC; NK A@,1<j <r, 


Kel JC: (7.3.5) 
j=l 


and 


Y> V(Cj) <e. 


j=l 

Proof Since V(K) = 0, 
[ vecoax =0 
Cc 


if C is any cube containing K. From this and the definition of the integral, there is a é > 0 
such that if P is any partition of C with ||P || < 6 and o is any Riemann sum of yx over 
P,, then 

O<o <e. (7.3.6) 
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Now suppose that P = {C,, Co,..., Cx} is a partition of C into cubes with 
|| P || < min(p, 6), (7.3.7) 


and let C, C2, ..., Cy be numbered so thatC; 1 K A Oifl <j <randC;NK =9 
ifr +1 <j <k. Then (7.3.5) holds, and a typical Riemann sum of yx over P is of the 
form 


o =) ¥K(X;)V(C;) 


j=l 
with X; € Cj, 1 <j <r. In particular, we can choose X; from K, so that wx(X;) = 1, 
and 


; 
c= > VIC). 
j=l 
Now (7.3.6) and (7.3.7) imply that C,, C2, ..., C; have the required properties. an 


Transformations of Jordan-Measurable Sets 


To formulate the theorem on change of variables in multiple integrals, we must first con- 
sider the question of preservation of Jordan measurability under a regular transformation. 


Lemma 7.3.4 Suppose that G : R” — R" is continuously differentiable on a bounded 
open set S, and let K be a closed subset of S with zero content. Then G(K) has zero 
content. 


Proof Since K is a compact subset of the open set S, there is a 0; > 0 such that the 
compact set 
Kp, = {X| dist(X, K) < pi} 


is contained in S (Exercise 5.1.26). From Lemma 6.2.7, there is a constant M such that 
IG(Y) — G(X)| < M|Y—-X| if X,Ye Ko,. (7.3.8) 


Now suppose that « > 0. Since V(K) = 0, there are cubes C;, Co, ..., C; with edge 
lengths 51, 52,..., Sr < pi/./n such thatC; NK £49,1<j <r, 


; 
Kc 'e C;, 
j=1 


and 


Y\V(Cj) <e€ (7.3.9) 


J=1 
(Lemma 7.3.3). For] < j <r,letX; €C; 1K. IfX € Cj, then 


|X—X;| <sjVn <p, 
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so X € K and |G(X)—G(X;)| < M|X—X,| < M./ns;, from (7.3.8). Therefore, G(C; ) 
is contained in a cube C ; with edge length 2M ./ns;, centered at G(X; ). Since 
V(C j) = 2M Jn)"s" = (2M Jn)" V(Cj), 
we now see that 
, 
G(kK) c JC; 
j=l 
and 
r a r 
dV ;) S$ QM Vn)" D1 V(C;) < QM Vin)re, 
j=1 jJ=1 


where the last inequality follows from (7.3.9). Since (2M ./n)” does not depend on e«, it 
follows that V(G(K)) = 0. an] 


Theorem 7.3.5 Suppose that G : R” — R" is regular on a compact Jordan measur- 
able set S. Then G(S) is compact and Jordan measurable. 


Proof We leave it to you to prove that G(S) is compact (Exercise 6.2.23). Since S 
is Jordan measurable, V(0S) = 0, by Theorem 7.3.1. Therefore, V(G(0S)) = 0, by 
Lemma 7.3.4. But G(0S) = d(G(S)) (Exercise 6.3.23), so V(0(G(S))) = 0, which 
implies that G(S}) is Jordan measurable, again by Theorem 7.3.1. 0 


Change of Content Under a Linear Transformation 


To motivate and prove the rule for change of variables in multiple integrals, we must know 
how V(L(S)) is related to V(S) if S is a compact Jordan measurable set and L is a nonsin- 
gular linear transformation. (From Theorem 7.3.5, L(S) is compact and Jordan measurable 
in this case.) The next lemma from linear algebra will help to establish this relationship. 
We omit the proof. 


Lemma 7.3.6 A nonsingularn x n matrix A can be written as 

A= ExEx-1-:: Ei, (7.3.10) 
where each E; is a matrix that can be obtained from the n Xx n identity matrix I by one of 
the following operations: 
(a) interchanging two rows of I; 
(b) multiplying a row of I by a nonzero constant; 
(c) adding a multiple of one row of I to another. 


Matrices of the kind described in this lemma are called elementary matrices. The key to 
the proof of the lemma is that if E is an elementary n x n matrix and A is any n x n matrix, 
then EA is the matrix obtained by applying to A the same operation that must be applied 
to I to produce E (Exercise 7.3.6). Also, the inverse of an elementary matrix of type (a), 
(b), or (c) is an elementary matrix of the same type (Exercise 7.3.7). 


The next example illustrates the procedure for finding the factorization (7.3.10). 
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Example 7.3.1 The matrix 
0 1 1 
A=|]10 1 
2 2 0 


is nonsingular, since det(A) = 4. Interchanging the first two rows of A yields 


101 £. 
A;=]0 1 1 = E,A, 
22 0 
where 
= 0 1 0 
E,; = 1 0 0 
0 0 1 


Subtracting twice the first row of A, from the third yields 


where 


Subtracting twice the second row of Az from the third yields 


1 0 1 Pare 
A3=]|0 1 1 | = E3E.E,A, 
0 0 -4 
where 
zx 1 0 0 
E3=]| 0 1 0 
0 —2 1 
Multiplying the third row of A3 by —+ yields 
1 0 1 aah 
Ag=|0 1 1 | = B4A3E2E,A, 
0 0 1 
where 
1 0 0 
E,=] 0 1 0 
0 0 —4 
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Subtracting the third row of A4 from the first yields 


OO) 2 ek 
A5s=]|0 1 1 = E5A4E3E2E,A, 
0 0 1 
where 
” 1 0 -1l 
E;=]| 0 1 0 
0 0 1 


~~ AR AKAKR XK 


where 


From (7.3.11) and Theorem 6.1.16, 


NDA AA AW KR XK n 


A = (EcE5E,E3E2E,)! = E;'E5'E;'E,'E5'E;!. 


Therefore, 
A = E6E5E4E3E2EF, 
where 
_ 1 0 0 = 1 1 
y= = 0 1 1 4, Ey = ES = 0 1 04, 
0 0 1 0 1 
o 1 O 0 ” 1 0 
E; = Aj’ = 0 1 0 |, kj =; = 0 1 04, 
0 0 -4 0 1 
= 1 0 0 = 0 1 0 
B=E =| 0 10.|), Ege ky =| 1:0 0 
2 0 1 0 0 1 


(Exercise 7.3.7(c)). 


(7.3.11) 


Lemma 7.3.6 and Theorem 6.1.7(c) imply that an arbitrary invertible linear transforma- 


tion L : R” — R”, defined by 
X = L(Y) = AY, 


can be written as a composition 
L=L,zo Lg} o-+-oly, 


where 
L;(Y) =E;Y, 1<i<k. 


(73,12) 


(7.3.13) 
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Theorem 7.3.7 /fS is a compact Jordan measurable subset of R” and L : R" > R" 
is the invertible linear transformation X = L(Y) = AY, then 


V(L(S)) = | det(A)|V(S). (7.3.14) 
Proof Theorem 7.3.5 implies that L(S) is Jordan measurable. If 
V(L(R)) = | det(A)|V(R) (7.3.15) 


whenever R is a rectangle, then (7.3.14) holds if S is any compact Jordan measurable 
set. To see this, suppose that « > 0, let R be a rectangle containing S, and let P = 
{Ri, Ro,..., Rx} be a partition of R such that the upper and lower sums of ws over P 
satisfy the inequality 

S(P) —s(P) <e. (7.3.16) 


Let U, and U2 be as in (7.3.2). From (7.3.3) and (7.3.4), 
s(P)= D> V(Rj) < VS) < D> (RI) + DS VR) = S(P). (7.3.17) 


jeu, JEU Jeug 
Theorem 7.3.7 implies that L(R1), L(R2), ..., LCR) and L(S) are all Jordan measurable. 
Since 

'e Rj CSC 'e Rj ; 
Jeuy jE81{U8> 
it follows that 
L| |) Ry) eL@yecel L) 8 
JEU, J€8US82 

Since L is one-to-one on R”, this implies that 


>> VL(R;)) < VIS) = D> VL(R;)) +S VL(R;)). (7.3.18) 


JEU, JEUy JEU2 
If we assume that (7.3.15) holds whenever R is a rectangle, then 


V(L(Rj)) = |det(A)|V(Rj), IS j Sk, 


so (7.3.18) implies that 
V(L(S)) 
SP) S Taeqayy = 3). 


This, (7.3.16) and (7.3.17) imply that 


VS) 


hence, since € can be made arbitrarily small, (7.3.14) follows for any Jordan measurable 
set. 
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To complete the proof, we must verify (7.3.15) for every rectangle 
= [a1, by] x [a2, ba] x +++ x [an, bn) = Ty X Ip X ++ X Ty. 
Suppose that A in (7.3.12) is an elementary matrix; that is, let 
X =L(Y) = 
CASE 1. If E is obtained by interchanging the ith and jth rows of I, then 


yr ifr Aiandr F 7; 
Xr= yj ifr =i; 
y ifr=j. 


Then L() is the Cartesian product of 11, /2,..., In with J; and J; interchanged, so 
V(L(R)) = V(R) = | det(E)|V(R) 


since det(E) = —1 in this case (Exercise 7.3.7(a)). 
CASE 2. If E is obtained by multiplying the rth row of I by a, then 


yr ifr £i, 


xy = ; f 
J ay; ifr =i. 


Then 
L(R) = Ke) x& Gey xT) x Tya4 xe xX Ty, 


where // is an interval with length equal to |a| times the length of J;, so 
VL(R)) = Ja|V(R) = | det(E)|V(R) 


since det(E) = a in this case (Exercise 7.3.7(a)). 
CASE 3. If E is obtained by adding a times the jth row of I to its ith row (j 4 7), then 


Then 
L(R) = | G15 2250555 %n) | Gi +axj <x; <b; +axj; anda, <x; <b,ifr F i}, 


which is a parallelogram ifm = 2 and a parallelepiped ifn = 3 (Figure 7.3.1). Now 
V(L(R)) = / dX, 
L(R) 


which we can evaluate as an iterated integral in which the first integration is with respect 
to x;. For example, if i = 1, then 


bn-1 bo aes 
V(L(R)) = [ ie i care j. re / (73.19) 
an—| 


a, +axj; 
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Since 


by +ax; by 
/ dy, = dyi, 
a 


ptax; aj 


(7.3.19) can be rewritten as 


bn bn-1 bo by 
V(L(R)) =f dx» f dina f dx2 dx, 


n-1 2 a) 


= (bn — an)(bn—-1 — Qn—-1) +++ (61 — a1) = V(R). 


Hence, V(L(R)) = | det(E)|V(R), since det(E) = 1 in this case (Exercise 7.3.7(a)). 


Figure 7.3.1 
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From what we have shown so far, (7.3.14) holds if A is an elementary matrix and S' is 


any compact Jordan measurable set. If A is an arbitrary nonsingular matrix, 
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then we can write A as a product of elementary matrices (7.3.10) and apply our known 
result successively to Ly, La, ..., Lx (see (7.3.13)). This yields 


V(L(S)) = | det(Ex)| | det(Ex_1)|---|detE,|V(S) = | det(A)|V(S), 


by Theorem 6.1.9 and induction. q 


Formulation of the Rule for Change of Variables 


We now formulate the rule for change of variables in a multiple integral. Since we are for 
the present interested only in “discovering” the rule, we will make any assumptions that 
ease this task, deferring questions of rigor until the proof. 


Throughout the rest of this section it will be convenient to think of the range and domain 
of a transformation G : R” — R” as subsets of distinct copies of R”. We will denote the 
copy containing Dg as E”, and write G : E” — R” and X = G(Y), reversing the usual 
roles of X and Y. 


If G is regular on a subset S of E”, then each X in G(S) can be identified by specifying 
the unique point Y in S such that X = G(Y). 


Suppose that we wish to evaluate /- 7 J (X) dX, where T is the image of a compact Jordan 
measurable set S under the regular transformation X = G(Y). For simplicity, we take S to 
be a rectangle and assume that f is continuous on T = G(S). 

Now suppose that P = {Rj, Ro,..., Rx} is a partition of S and T; = G(R;) (Fig- 
ure 7.3.2). 


< 
— 


Figure 7.3.2 
Then 
k 
| fovax = >| f(X%) dX (7.3.20) 
T ya Ly 


(Corollary 7.1.31 and induction). Since f is continuous, there is a point X; in 7; such that 


7, f(X) dX = f(X)) / dX = f(X;)V(T;) 
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(Theorem 7.1.28), so (7.3.20) can be rewritten as 


k 
[ fooax = D> f(Xj)V(Tj). (7.3.21) 


j=l 
Now we approximate V(7;;). If 
X; = G(Y;), (7.3.22) 
then Y; € R; and, since G is differentiable at Y;, 
G(Y) ~ G(Y;) + G’(Y;)(Y -Y)). (7.3.23) 


Here G and Y — Y; are written as column matrices, G’ is a differential matrix, and “~” 
means “approximately equal” in a sense that we could make precise if we wished (Theo- 
rem 6.2.2). 


It is reasonable to expect that the Jordan content of G(R; ) is approximately equal to the 
Jordan content of A(R;), where A is the affine transformation 


A(Y) = G(Y;) + G(¥;)(¥ —- Yj) 
on the right side of (7.3.23); that is, 
V(G(R;)) © V(A(R;)). (7.3.24) 
We can think of the affine transformation A as a composition A = A3 0 Ag o Aq, where 
Ai(¥) =Y-Yj, 
A2(Y) = G'(Y;)Y, 
and 


A3(Y) = G(Y;) + Y. 


Let RK’, = Aj(R;). Since A; merely shifts R; toa different location, R’; is also a rectangle, 
and 
V(R;,) = V(R;). (7.3.25) 


Now let Ri a A2(Ri; ). in general, Ri is not a rectangle.) Since Ag is the linear transfor- 
mation with nonsingular matrix G’(Y ; ), Theorem 7.3.7 implies that 


V(R4)) = |detG'(¥;)|V(Rj) = |JG(Y;)|V(Rj). (7.3.26) 


where JG is the Jacobian of G. Now let R’” = A3(R’). Since A3 merely shifts all points 
in the same way, 
V(RM) = V(R"). (7.3.27) 


Now (7.3.24)-(7.3.27) suggest that 
V(Tj) © |JG(¥;)|V(Rj). 
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(Recall that T; = G(R;).) Substituting this and (7.3.22) into (7.3.21) yields 


k 
[ FX) dX ~ MGW, |JEW))|V(Rj). 


j=1 


But the sum on the right is a Riemann sum for the integral 
[ seonieiay. 
which suggests that 
[ feoax= | reoieoay. 


We will prove this by an argument that was published in the American Mathematical 
Monthly [Vol. 61 (1954), pp. 81-85] by J. Schwartz. 


The Main Theorem 


We now prove the following form of the rule for change of variable in a multiple integral. 


Theorem 7.3.8 Suppose that G : E" — R" is regular on a compact Jordan measur- 
able set S and f is continuous on G(S). Then 


f(X)dX = i f(G(Y))|JG(Y)| dy. (7.3.28) 
G(S) S 


Since the proof is complicated, we break it down to a series of lemmas. We first observe 
that both integrals in (7.3.28) exist, by Corollary 7.3.2, since their integrands are continu- 
ous. (Note that S is compact and Jordan measurable by assumption, and G(.S) is compact 
and Jordan measurable by Theorem 7.3.5.) Also, the result is trivialif V(S) = 0, since then 
V(G(S)) = 0 by Lemma 7.3.4, and both integrals in (7.3.28) vanish. Hence, we assume 
that V(S) > 0. We need the following definition. 


Definition 7.3.9 If A = [a;;] is ann xn matrix, then 


n 
max Yo laijl||1<i<n 
j=l 


is the infinity norm of A, denoted by || Aloo. 


Lemma 7.3.10 Suppose that G : E"” — R" is regular ona cube C in EE", and let A be 
a nonsingularn x n matrix. Then 


V(G(C)) < | det(A)| [max {|A7!G’(Y) loo | ¥Y € C}]" V(C). (7.3.29) 
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Proof Let s be the edge length of C. Let Yo = (ci, C2,..., Cn) be the center of C, and 

suppose that H = (y1, y2,..-, vn) € C. If H = (Ay, A2,..., Ay) is continuously differen- 

tiable on C, then applying the mean value theorem (Theorem 5.4.5) to the components of 

H yields 

dh; (Yi) 
dy; 


hi(X) —hi(¥o) = >> 


J=1 


Qyj-—cj), Isisn, 


where Y; € C. Hence, recalling that 


H’(Y) = E ] 


Oyj i,j=l1 
applying Definition 7.3.9, and noting that |y; —c;| < s/2,1< j <n, we infer that 
s : 
|hi(Y) — hj (Yo)| < 5 max {IIH’(Y)llo |YEC}, L<i<n. 
This means that H(C) is contained in a cube with center Xo = H(Yo) and edge length 


s max {||H’(Y)|loo |Y eC}. 


Therefore, 
V(H(C)) [max {||H’(Y)|loo]” |Y € C} 5” (7.3.30) 
— [max {||H’(Y)|loo]” ix € c} V(C). 
Now let 
L(X) =A 'X 
and set H = LoG; then 
H(C) =L(G(C)) and H =A'G’, 
so (7.3.30) implies that 
V(L(G(C))) < [max {|A“'G’(Y)|loo |¥ € C}]" V(C). (7.3.31) 
Since L is linear, Theorem 7.3.7 with A replaced by A~! implies that 
VL(G(C))) = | det(A)"|V(G(C)). 
This and (7.3.31) imply that 
| det(A~!)|V(G(C)) < [max {]A7'G/(Y)lloo | ¥ ¢ C}]" VIC). 
Since det(A~!) = 1/ det(A), this implies (7.3.29). an] 


Lemma 7.3.11 [fG: E” > R” is regular on a cube C in R", then 


V(G(C)) < [ omtay. (7.3.32) 
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Proof Let P bea partition of C into subcubes C;, C2, ..., Cx with centers Y;, Yo, ..., 
Y;,. Then 
k 
V(G(C)) = 5) VGC). (7.3.33) 
j=l 


Applying Lemma 7.3.10 to C; with A = G’(A;) yields 
V(G(C;)) < |JG(¥;)| [max {||(G’'(Y;))"G'(Y) loo | ¥ € esis V(C;). (7.3.34) 
Exercise 6.1.22 implies that if ¢ > 0, there is a 6 > 0 such that 
max {||(G'(¥;))'G'(Y)llo |YECi}<l+e, 1<j<k, if |PI<é. 
Therefore, from (7.3.34), 
ViG(C;)) < A + 6)" |JG(Y,)|V(C;), 
so (7.3.33) implies that 


k 
VG(C)) <A+6)" So [JG A)|VIC;) if PI <6 


J=1 


Since the sum on the right is a Riemann sum for /. |JG(Y)|dY and € can be taken arbi- 
trarily small, this implies (7.3.32). q 


Lemma 7.3.12 Suppose that S is Jordan measurable and €, p > 0. Then there are 
cubes Cy, C2, ..., Cy in S with edge lengths < p, such thatC; C S,1 <5 j <7, 
cPnc? =@ifi F j, and 


V(S) < Do V(C;) +. (7.3.35) 
j=l 


Proof Since S is Jordan measurable, 
/ Ws (X)dX = V(S) 
Cc 
if C is any cube containing S. From this and the definition of the integral, there is a 6 > 0 


such that if P is any partition of C with || P|| < 6 and o is any Riemann sum of wg over 
P,theno > V(S) — €/2. Therefore, if s(P) is the lower sum of yg over P, then 


s(P)>V(S)-—e if ||PI| <6. (7.3.36) 
Now suppose that P = {C1,C2,...,C x} is a partition of C into cubes with ||P|| < 
min(p,6), and let Cy, Cz, ..., Cy be numbered so that C; C S if 1 < j < r and 


C;NS° £ Oif j > r. From (7.3.4), s(P) = i V(C,). This and (7.3.36) imply 
(7.3.35). Clearly, C? NC? = if i # j. a 
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Lemma 7.3.13 Suppose thatG : E" > R" is regular on a compact Jordan measur- 
able set S and f is continuous and nonnegative on G(S). Let 


O(S) = / f(X)dX — i f(G(Y))|JG(Y)| dy. (7.3.37) 
G(S) S 


Then QO(S) < 0. 


Proof From the continuity of JG and f on the compact sets S and G(S), there are 
constants MM, and M> such that 


\JG(Y)| <M, if Yes (7.3.38) 


and 
|f(X)|< M2 if Xe G(S) (7.3.39) 


(Theorem 5.2.11). Now suppose that « > 0. Since f o G is uniformly continuous on S 
(Theorem 5.2.14), there is a 5 > O such that 


| f(G(Y)) — f(G(Y’))| < « if JY-—Y'| <dandY,Y’ eS. (7.3.40) 
Now let Ci, C2, ..., C, be chosen as described in Lemma 7.3.12, with p = 6/./n. Let 


sie {vesive Ui} 


j=l 
Then V(S,) < € and 


S= ( 2) U Si. (7.3.41) 
j=l 


Suppose that Y;, Y2,..., Y; are points in Cy, Co,...,C, and X; = G(Y;), 1 <j <r. 
From (7.3.41) and Theorem 7.1.30, 


Q(s) = / F(X) dx — / f(G(Y))|JG(X)| d¥ 
G(S1) Si 
+ X) dx — G(Y))| JG(Y)| dv 
ae vhf (w))|76Q) 
= / F(X) dX — / f(GY)|JG(X)| d¥ 
G(S1) Sy 
+ X) — f(A;)) dX 
De saat )- f(A)) 


+% [ (EW) - LGM |G av 
j=l J 


+ fe) (vicresy - fen) x) : 


J=1 
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Since f(X) => 0, 
[. seoenay =o. 
Sy 
and Lemma 7.3.11 implies that the last sum is nonpositive. Therefore, 
OS)<ht+ht+h, (7.3.42) 
where : 
n=, foodx, b=] (fey-sexplax. 
G(S1) j=l G(C;) 
and 


a 3) IPG)Xj)) — (GM))||JGM)| dy. 
j=l’ us 


We will now estimate these three terms. Suppose that € > 0. 


To estimate /,, we first remind you that since G is regular on the compact set S, G is 
also regular on some open set © containing S (Definition 6.3.2). Therefore, since Sj C S$ 
and V(S,) < €, S; can be covered by cubes Tj, Tz, ..., Tim such that 


Y\V(Tj) <e (7.3.43) 
j=l 
and G is regular on Ua T;. Now, 
Ty < M2V(G(S;)) (from (7.3.39)) 
< M2 > V(G(7;)) (since $1 C U"_, Tj) 


j=1 
m 
< Mp >| |JG(Y)|dY (from Lemma 7.3.11) 
2 T; 
jJ=l°/ 
< M.Mye (from (7.3.38) and (7.3.43)). 


To estimate /2, we note that if X and X; are in G(C;) then X = G(Y) and X; = G(Y;) 
for some Y and Y; in C;. Since the edge length of C; is less than 6/./n, it follows that 
lY — Y;| < 6,so|f(X) — f(X;)| < €, by (7.3.40). Therefore, 


In <e > V(G(C;)) 


j=l 


sey | |JG(Y)|dY (from Lemma 7.3.11) 
ee 


<M, )° V(C;) (from (7.3.38)) 
j=l 
<eM,V(S) (since Uj_, Cj C S). 
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To estimate /3, we note again from (7.3.40) that | f(G(Y;)) — f(G(Y))| < ¢ if Y and 
Y; are in C;. Hence, 


Toe / |JG(Y)|dY 


< Myce) V(C;) (from (7.3.38) 
j=l 
< MV(S)e 


because L,_, Cj C S and C2 0 Cc? =Oifi £- j. 


From these inequalities on /;, /2, and /3, (7.3.42) now implies that 
Q(S) < Mi(M2 + 2V(S))e. 
Since € is an arbitrary positive number, it now follows that O(S) < 0. q 


Lemma 7.3.14 Under the assumptions of Lemma 7.3.13, Q(S) > 0. 


Proof Let 
Gi=G"', 8,;=G(S) fi =(JG)f oG, (7.3.44) 


and 


aisy=f  nooay- Si(Gi (X))| J Gy (X)| dX. (7.3.45) 


Since G; is regular on S; (Theorem 6.3.3) and fi is continuous and nonnegative on 
G,(S1) = S, Lemma 7.3.13 implies that O;(S,) < 0. However, substituting from (7.3.44) 
into (7.3.45) and again noting that G;($;) = S yields 


OS) = i. #(G(Y)|JGCX)| dY 


(7.3.46) 
7 Pe f(GG(X))| IGG" (X))|| JG“! (&)| dX. 


Since G(G~!(X)) = X, f(G(G~!(X))) = f(X). However, it is important to interpret the 
symbol J G(G~! (X)) properly. We are not substituting G~!(X) into G here; rather, we are 
evaluating the determinant of the differential matrix of G at the point Y = G~!(X). From 
Theorems 6.1.9 and 6.3.3, 


| JG(G~"(X)||JG7" (X)| = 1, 
so (7.3.46) can be rewritten as 


O80 = [ #(G(X))|JG(Y)| d¥ — } [OAK = 218). 


Since 0;(S1) < 0, it now follows that O(S) > 0. aa) 
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We can now complete the proof of Theorem 7.3.8. Lemmas 7.3.13 and 7.3.14 imply 
(7.3.28) if f is nonnegative on S. Now suppose that 


m = min { f(X) |X € G(S)} <0. 


Then f — mm is nonnegative on G(S), so (7.3.28) with f replaced by f — m implies that 
/ gl —m)dX= [seo —m)|JG(Y)|dY. (7.3.47) 
G 


However, setting f = 1 in (7.3.28) yields 


/ ax= | |JG(Y)| dy, 
G(S) S 


so (7.3.47) implies (7.3.28). an 


The assumptions of Theorem 7.3.8 are too stringent for many applications. For example, 
to find the area of the disc 


{@, y)|x*+y? <B, 


it is convenient to use polar coordinates and regard the circle as G(S), where 


r cos 6 
G(r, 6) = ace (7.3.48) 
and S is the compact set 
S ={,0)|0<r<1,0<6 <2n} (7.3.49) 


(Figure 7.3.3). 


X=G(y, 8) 
——_> 


Figure 7.3.3 
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Since 


G'(r,6) = cos@ —r sind iF 


sin0d  rcosé 


I 
i 


it follows that JG(r, 0) = r. Therefore, formally applying Theorem 7.3.8 with f = 


yields 
1 20 
a= f ax =f rac.6= [rar dO =n. 
G(S) S 0 0 


Although this is a familiar result, Theorem 7.3.8 does not really apply here, since G(r, 0) = 
G(r, 277), 0 < r < 1, so G is not one-to-one on S, and therefore not regular on S. 

The next theorem shows that the assumptions of Theorem 7.3.8 can be relaxed so as to 
include this example. 


Theorem 7.3.15 Suppose thatG : E” — R" is continuously differentiable on a 
bounded open set N containing the compact Jordan measurable set S, and regular on 
S°. Suppose also that G(S) is Jordan measurable, f is continuous on G(S), and G(C) is 
Jordan measurable for every cube C C N. Then 


F(X) dX = / F(G(Y))|JG(Y)| dy. (7.3.50) 
G(S) S 


Proof Since f is continuous on G(S) and (|J G]) f oG is continuous on S, the integrals 
in (7.3.50) both exist, by Corollary 7.3.2. Now let 


p = dist (0S, N°) 


(Exercise 5.1.25), and 
: p 
P=3Y | dist(Y,aS)! < =. 
(Y | aiswy,as)} <4 


Then P is a compact subset of N (Exercise 5.1.26) and dS C P°® (Figure 7.3.4). 
Since S$ is Jordan measurable, V(0.S) = 0, by Theorem 7.3.1. Therefore, if ¢ > 0, we 


can choose cubes C,, Co, ..., Cy in P® such that 
k 
asc\ljcp (7.3.51) 
j=l 

and 

k 

V(C;) <€ (7.3.52) 

j=l 


Now let S; be the closure of the set of points in S$ that are not in any of the cubes C;, 
C2, ..., Cx; thus, 


Si 8h (UE GG). 
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Because of (7.3.51), Sj N 0S = @, so S; is a compact Jordan measurable subset of 5°, 
Therefore, G is regular on S$), and f is continuous on G(S;). Consequently, if Q is as 
defined in (7.3.37), then Q(S;) = 0 by Theorem 7.3.8. 


os 


me) 


N = open set bounded by outer curve 
S = closed set bounded by inner curve 


Figure 7.3.4 


Now 
O(S) = Q(S1) + Q(S N ST) = Q(S NST) (7.3.53) 
(Exercise 7.3.11) and 


|O(SNS%)| < i _ fax} + 


1 


/ “f(ECY)|FECD)| ay] 
SASF 


But 


J f(G(Y))|JG(Y)| dY| < Mi) M2V(S 1 Sf), (7.3.54) 
sns¢ 


where M, and Mp are as defined in (7.3.38) and (7.3.39). Since SM Sf C WA Cy 
(7.3.52) implies that V(S 9 SF) < €; therefore, 


| [fGen iemiay] = Mime, (73.55) 
SASS 
from (7.3.54). Also 
k 
/ f(X%) dX] < M,V(G(S 1S%)) < Mz Y* V(G(C;)). (7.3.56) 
G(SNST) j=l 
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By the argument that led to (7.3.30) with H = G andC = C;, 
V(G(Cj)) < [max {||G'(Y) oo | ¥ € Cj} |" ViCj), 


so (7.3.56) can be rewritten as 


i, F(X) dX} < Mz [max {||G'(Y) loo |¥ € P}]"e, 

G(SNS¢) 

because of (7.3.52). Since € can be made arbitrarily small, this and (7.3.55) imply that 
O(S N Sy) = 0. Now Q(S) = 0, from (7.3.53). aa] 


The transformation to polar coordinates to compute the area of the disc is now justi- 
fied, since G and S as defined by (7.3.48) and (7.3.49) satisfy the assumptions of Theo- 
rem 7.3.15. 


Polar Coordinates 


If G is the transformation from polar to rectangle coordinates 


x rcos@ 
= G(r, 0) = eae |. (7.3.57) 


then JG(r, 0) = r and (7.3.50) becomes 


/ fle»d(e.y) = | f(rc0s8.r sind) dCr.6) 
G(S) S 


if we assume, as is conventional, that S is in the closed right half of the r@-plane. This 
transformation is especially useful when the boundaries of S can be expressed conveniently 
in terms of polar coordinates, as in the example preceding Theorem 7.3.15. Two more 
examples follow. 


Example 7.3.2 Evaluate 


_ 2 
r= fe + y)d(x, y), 


where T is the annulus 
T ={(x,y)|1<x?+y? <4} 


(Figure 7.3.5(b)). 


Solution We write T = G(S), with G as in (7.3.57) and 


S={(r,0)|1<r<2,0<0<2n} 
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(Figure 7.3.5(a)). Theorem 7.3.15 implies that 

I= Le cos? 6 + rsin@)r d(r, 0), 
which we evaluate as an iterated integral: 


=f r arf" (r cos? 6 + sin6) dé 


1 
-f r arf (5 —_ + 5 cos 26 + sin 8) dé since cos? 6 = 5 +026) 
20 2 412 
1 
-{ cael dr=x | a a 
1 4A 2 4 6=0 1 y 4 1 4 
20 


(a) (b) 
Figure 7.3.5 


Example 7.3.3 Evaluate 
i= ; y d(x, y), 
T 


where T is the region in the x y-plane bounded by the curve whose points have polar coor- 
dinates satisfying 
r=l1-—cosé, 0<0<z 


(Figure 7.3.6(b)). 


Solution We write T = G(S), with G as in (7.3.57) and S the shaded region in 
Figure 7.3.6(a). From (7.3.50), 


l= fo sin 0)r d(r, 0), 
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which we evaluate as an iterated integral: 


1 1—cos 6 1 1 
/ sino do | Par==f (1 —cos 6)? sin @ dé 
0 0 3 Jo 


~ 
II 


wu 


1 
—(1 —cos6)4 
12 


(a) (b) 
Figure 7.3.6 


Spherical Coordinates 


If G is the transformation from spherical to rectangular coordinates, 


x rcos0cos¢@ 
y |=G(r,6,¢) =| rsinOcos¢d |, (7.3.58) 
Zz rsing 


then 
cos@cos@ —rsinOcos@ —rcosd sing 


G'(r,6,¢) =| sinOcos@ rcosAcosd —rsindsing 
sind 0 r cos @ 


and JG(r, 6,¢) = r2cos @, so (7.3.50) becomes 


| S(x,y, z) d(x, y, Zz) 
G(S) 
(7.3.59) 


= [_ f0r cos 8 cos 6.1 sin 860s 4, sin g)r? cos 6 d(r. 0.9) 
Ss 


if we make the conventional assumption that |@| < 2/2 andr > 0. 
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Example 7.3.4 Let a > 0. Find the volume of 
T = {(x,y,z)|x7+y? +27 <a’, x=0, y>=0, z= 0}, 


which is one eighth of a sphere (Figure 7.3.7(b)). 


(b) 
Figure 7.3.7 


Solution We write T = G(S) with G as in (7.3.58) and 


S = {(r,0,6)|O<r <a, 0<0<2/2,0<¢<7/2} 


Section 7.3 Change of Variables in Multiple Integrals 509 
(Figure 7.3.7(a)), and let f = 1 in (7.3.59). Theorem 7.3.15 implies that 


= = 2 
very= ff ax= fr cos d d(r, 8, d) 


a m/2 m/2 a 1 na? 
= 2 —~(£ \(2 piace 
=f r arf ao | cosa = (5) (F) 73.0 = — 


Example 7.3.5 Evaluate the iterated integral 


a Va2—x2 a2—x2—y2 
by xdx [ ay | zdz (a>0). 
0 0 0 


Solution We first rewrite J as a multiple integral 
I =i xz d(x, y,Z) 
G(S) 


where G and S are as in Example 7.3.4. From Theorem 7.3.15, 


I= fo cos 4 cos ¢)(r sing)(r? cos d) d(r, 6, d) 
Ss 
a m/2 m/2 a 1 a> 
_ 4 2a _ {Ft eo eee 
=| r arf cos 00 | cos d sing dd = ( =) 73.0 (5) 5” 


Other Examples 


We now consider other applications of Theorem 7.3.15. 


Example 7.3.6 Evaluate 


r= [oe +4yyd(e.y), 
where T is the parallelogram bounded by the lines 
x+ty=1, x+y=2, x-2y=0, and x—-2y=3 
(Figure 7.3.8(b)). 


Solution We define new variables u and v by 


u x+y 
Le [=Reod=| 22, | 
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>< 


>< 


(b) 


(a) 


x-2y=3 


> x 


xt+y=2 


Figure 7.3.8 


Then 


‘ ]-rte= 


JF (u,v) = | 


and T = F~!(S), where 


BIR WIN 


2u+uv 


u—v ’ 


3 


S={u,v)|1<u<2,0<v <3} 
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(Figure 7.3.8(a)). Applying Theorem 7.3.15 with G = F~! yields 


=/[(F eS) ) a. v) = 6) nee v) 
=if af (Qu —v)du = = ah a) 
= 5 ['o—mae =F (a0 2) oy 


0 2 
Example 7.3.7 Evaluate 


dv 
=1 


ra f Petar + aCe), 
T 


where T is the annulus T = {(x, y)|a? < x? + y? < b?} witha > 0 and b > 0 (Fig- 
ure 7.3.9(a)). 


(a) (b) 
Figure 7.3.9 


Solution The forms of the arguments of the exponential functions suggest that we 
introduce new variables u and v defined by 


3 x2 — y? 
fo Jove [Ma | 


and apply Theorem 7.3.15 to G = F~!. However, F is not one-to-one on T° and therefore 
has no inverse on T° (Example 6.3.4). To remove this difficulty, we regard T as the union 
of the quarter-annuli 7;, 72, 73, and 74 in the four quadrants (Figure 7.3.9)(b)), and let 


y= fe Pe (a2 + yy d(x, »). 
T 


J 
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Since the pairwise intersections of 71, T2, T3, and 74 all have zero content, 7 = J, + 
In + I3 + Ig (Corollary 7.1.31). Theorem 7.3.8 implies that 1) = Ig = Iz = I4 (Exer- 
cise 7.3.12), so J = 4/,. Since J; does not contain any pairs of distinct points of the form 
(Xo, Yo) and (—xo, —yo), F is one-to-one on T; (Example 6.3.4), 


F(T,) = S; = {(u,v) |a* <u? + v? < b*, v= 0} 


(Figure 7.3.10(b)), 


> Pp 


(a) (b) 
Figure 7.3.10 


and a branch G of F~! can be defined on S; (Example 6.3.8). Now Theorem 7.3.15 implies 
that 


I= i el -¥) 4x? y? (42 + y?)|JG(u, v)| d(u, v), 
Si 
where x and y must still be written in terms of u and v. Since it is easy to verify that 
JF (x, y) = 4(x* + y*) 


and therefore 


1 
JGtu, v) = ——-. 
— A(x? + y?) 
doing this yields 
1 
h=- 7 e+”? du, v). (7.3.60) 
4 Js, 


To evaluate this integral, we let p and @ be polar coordinates in the wv-plane (Figure 7.3.11) 


and define H by 
u | _ _ | pcosa |. 
v |- Hip.a) =| psina IE 


then S; = H(S1), where 


Si = {(p,a)|a? <p <b?,0<a<n} 
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(Figure 7.3.10(a)); hence, applying Theorem 7.3.15 to (7.3.60) yields 


1 1 
= ih e | JH(p, a)| d(p,a) = ih pe? d(p,@) 
4 Sy 4 Sy 


1 st b? b+ _ at 
= ;/ aa | pe? dp = ae) 
4 0 a2 8 


fai = =(e" — eM), 


hence, 


(u, v) 


> uU 


Figure 7.3.11 


Example 7.3.8 Evaluate 
[= / aac aalaaea 716 sie cee eh 
T 


where T is the region defined by 


ai SxXytxote- +x <5), Lin. 


Solution We define the new variables y1, y2,..., Yn by Y = F(X), where 
ARM =m tx2t--+%;,, si sa, 
If G = F"! then T = G(S), where 
S = [a1, b,] x [a2, bo] x +++ x [an, by], 


and JG(Y) = 1, since JF(X) = 1 (verify); hence, Theorem 7.3.8 implies that 
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1. 


P= f dir. Yarn 
S 


by bo bn-1 bn 
= dy, dya- | din f "dyn 
a\ a2 a a 


n—-1 n 


= (by — @1)(b2 — a2) --- (bn—1 — Gn_1)(e°" — €"). 


7.3 Exercises 


Give a counterexample to the following statement: If S; and S2 are disjoint subsets 
of arectangle R, then either 


/ rs, (X) dX + rs)(X) dX = / Ws, us» (X) dX 
R R R 


or 


[ vscoax+ | vsXaXx = | Ws,US>(X) dX. 
YR ZR ZR 


Show that a set F has content zero according to Definition 7.1.14 if and only if F 
has Jordan content zero. 


Show that if S$; and S> are Jordan measurable, then so are S$; U Sz and $;M So. 
Prove: 


(a) If S is Jordan measurable then so is S, and V(S) = V(S). Must S be Jordan 
measurable if S is? 

(b) If 7 is a Jordan measurable subset of a Jordan measurable set S, then S — T 
is Jordan measurable. 

Suppose that H is a subset of a compact Jordan measurable set S' such that the inter- 

section of H with any compact subset of S° has zero content. Show that V(H) = 0. 

Suppose that E is an m x n elementary matrix and A is an arbitrary n x p matrix. 

Show that EA is the matrix obtained by applying to A the operation by which E is 

obtained from the n x n identity matrix. 

(a) Calculate the determinants of elementary matrices of types (a), (b), and (c) 
of Lemma 7.3.6. 

(b) Show that the inverse of an elementary matrix of type (a), (b), or (c) is an 
elementary matrix of the same type. 


(c) Verify the inverses given for E,,..., E¢ in Example 7.3.1. 
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8. Write as a product of elementary matrices. 


101 2 3-2 
(a)}| 1 1 0 (b)}| 0 -1 5 
01 1 0 —2 4 
9. Suppose that ad—bc £ 0,u, < uz, and vy < v2. Find the area of the parallelogram 
bounded by the lines 


ax+by =, ax + by =u, 
cx + dy = v4, cx +dy =02. 
10. Find the volume of the parallelepiped defined by 


1<2x+3y-2z<2, 5<-x+5y<7, 1<-2x+4y <6. 


11. In writing Eqn. (7.3.53) we assumed that 


fon dx = | foo dx+ [ f(®) dX. 
G(S1) G(SNSS 


G(S) nS¢) 


Justify this. HINT: Show that G(S;) MN G(S NM Sf) has zero content. 
12. Use Theorem 7.3.8 to show that J) = Iz = I3 = J, in Example 7.3.7. 
13. Lete; = +1,0 <i <n. Let T bea bounded subset of R” and 


T= {(e1X1, €2X2,..-, €nXn) | Coe 7 eee om aa a 
Suppose that f is defined on T and define g on T by 


£(€1X1, €2X2,..-,€nXn) = Co f(X1, X2,.--, Xn). 


(a) Prove directly from Definitions 7.1.2 and 7.1.17 that f is integrable on T if 
and only if g is integrable on T, and in this case 


[emay = eo | £O0dX. 


(b) Suppose that T = 7, 
F(e1X1, €2X2,.--,€nXn) = —f(X1,X2,...,Xn), 
and f is integrable on T. Show that 
/ F(X) dX = 0. 
T 


14. Find the area of 
(a) {a y)|y <x <4y, 1<x4+2y <3}; 
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15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 
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(b) {(x,y)|2<xy <4, Iie y = 5x 


Evaluate 
[2 +27 + 0d.9.0. 
T 
where 
T = {(x,y.2||x-—yl <1 ly-zl <1 [etx] <1}. 
Evaluate 


/ (y? + xy —2x*) d(x, y), 
where T is the region binds by the curves 
xy=1, xy=2, y=x*, y=x?+1. 
Evaluate 
[et - ye ate.y) 
where T is the region in the at quadrant bounded by the hyperbolas 


eel, aS? 4 ay? H=2, ary? Ss 


Find the volume of the ellipsoid 


P) 2 2 

x y zZ 

ptp tao (a,b,c > 0). 
Evaluate 

ex ty? +27 
a d(x, Jy, Z), 
E 3f Xb yee 

where 


T = {x,y,z [9527 +y? +27 < 25}. 


Find the volume of the set T bounded by the surfaces z = 0, z = ./x? + y?, and 
x?+y? =4, 
Evaluate 


ce —y*)d(x, y,z), 


where 
T = {(x,y,2d|1<x?-y? <2,3<x7+y? <4,0<z<]}. 


Evaluate 


We Glee es ee = 
(a) / a i. San (b) i dx i, erty? dy 
0 y 0 0 


[Paes ye 


1 V1—x2 a/1—x2—y2 
(c) | ax [ ay | edz 
-1 —V1=x2 0 


23. 


24. 


25. 
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Use the change of variables 


x1 r cos 8; cos 62 cos 63 

x2 r sin 6; cos 62 cos 63 
= G(r, 01, 92, 03) = ; 

X3 r sin 62 cos 63 


x4 r sin 63 
to compute the content of the 4-ball 


i {(x1,%2,%3,%4) | xp +xz+xZt+xp <a’}. 


Suppose that A = [a;;] is a nonsingular n x n matrix and T is the region in R” 
defined by 


Oy < AjyX1 + aj2X2 +--+ + dinkn < Bi, [<i <n. 


(a) Find V(T). 
(b) Show that if ci, c2, ..., Cn are constants, then 


i DE Gm ax =O Sata: + Bo), 


j=l i=l 
where 
ay C1 
| ssagre| 
dn Cn 


If V, is the content of the n-ball T = {xX | |X| < Bt find the content of the n- 
dimensional ellipsoid defined by 


Leave the answer in terms of V,,. 


CHAPTER 8 


Metric Spaces 


IN THIS CHAPTER we study metric spaces. 


SECTION 8.1 defines the concept and basic properties of a metric space. Several examples 
of metric spaces are considered. 


SECTION 8.2 defines and discusses compactness in a metric space. 


SECTION 8.3 deals with continuous functions on metric spaces. 
8.1 INTRODUCTION TO METRIC SPACES 


Definition 8.1.1 A metric space is a nonempty set A together with a real-valued func- 
tion p defined on A x A such that if uv, v, and w are arbitrary members of A, then 


(a) p(u,v) = 0, with equality if and only if vu = v; 

(b) p(w, v) = p(v,u); 

(c) plu. v) < pu, w) + p(w, v). 

We say that p is a metric on A. | 


Ifn > 2 and vy, U2, ..., Uy are arbitrary members of A, then (c) and induction yield 
the inequality 


n—-1 


p(ui,Un) < >, plur,ui+s). 


i=1 


Example 8.1.1 The set R of real numbers with p(u, v) = |w — v| is a metric space. 
Definition 8.1.1(c) is the familiar triangle inequality: 


ju—v| <|u—wl|+|w—yl. a 
Motivated by this example, in an arbitrary metric space we call p(u, v) the distance from 


u to v, and we call Definition 8.1.1(¢) the triangle inequality. 


518 
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Example 8.1.2 If A is an arbitrary nonempty set, then 


weve 0 ifu=v, 
PYEY = V1 itu zu 


is a metric on A (Exercise 8.1.5). We call it the discrete metric. | 


Example 8.1.2 shows that it is possible to define a metric on any nonempty set A. In 
fact, it is possible to define infinitely many metrics on any set with more than one member 
(Exercise 8.1.3). Therefore, to specify a metric space completely, we must specify the 
couple (A, eo), where A is the set and p is the metric. (In some cases we will not be so 
precise; for example, we will always refer to the real numbers with the metric p(u, v) = 
|u — v| simply as R.) 

There is an important kind of metric space that arises when a definition of length is 
imposed on a vector space. Although we assume that you are familiar with the definition 
of a vector space, we restate it here for convenience. We confine the definition to vector 
spaces over the real numbers. 


Definition 8.1.2 A vector space A is a nonempty set of elements called vectors on 
which two operations, vector addition and scalar multiplication (multiplication by real 
numbers) are defined, such that the following assertions are true for all U, V, and W in 
A and all real numbers r and s: 

1U+VeEA; 

2.0+V=V+0; 

3.U+(V+W) =(U+V)+W; 

4. There is a vector 0 in A such that U + 0 = U; 

5. There is a vector —U in A such that U + (—U) = 0; 

6.ruUeE A; 

7.r(U+V)=rU+rV; 

8. (r +5s)U =rU+sU; 

9. r(sU) = (rs)U; 
10.10 =U. | 


We say that A is closed under vector addition if (1) is true, and that A is closed under 
scalar multiplication if (6) is true. It can be shown that if B is any nonempty subset of A 
that is closed under vector addition and scalar multiplication, then B together with these 
operations is itself a vector space. (See any linear algebra text for the proof.) We say that 
B isa subspace of A. 


Definition 8.1.3 A normed vector space is a vector space A together with a real-valued 
function N defined on A, such that if uw and v are arbitrary vectors in A and a is a real 
number, then 


(a) N(u) = 0 with equality if and only if u = 0; 
(b) N(au) = |a|N(w); 
(c) Nuwt+v) < Nu) +N). 


We say that N is anorm on A, and (A, NV) is anormed vector space. 
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Theorem 8.1.4 /f(A, N) is a normed vector space, then 
p(x, y) = N(x—y) (8.1.1) 
is a metric on A. 
Proof From (a) withu = x — y, p(x, y) = N(x — y) = 0, with equality if and only 
if x = y. From (b) withu = x — y anda = —1, 
p(y, x) = N(y — x) = N(-(& — y)) = N@ — y) = p(x, y). 
From (c) withu = x-—zandv =z-y, 


p(x, y) = N(x—y) = N(x—-z)+ N@Z—y) = p@,z) + pl, y). an 


We will say that the metric in (8.1.1) is induced by the norm N. Whenever we speak of 
a normed vector space (A, NV), it is to be understood that we are regarding it as a metric 
space (A, ¢), where p is the metric induced by N. 


We will often write N(w) as ||u||. In this case we will denote the normed vector space as 


(A, ll - ID. 

Theorem 8.1.5 /fx and y are vectors in a normed vector space (A, N), then 
|N(x) — N(y)| < N@& — y). (8.1.2) 

Proof Since 


x=yt+(x-y), 
Definition 8.1.3(c) with uw = y and v = x — y implies that 


N(x) < N(y) + N(x — y), 


or 
N(x)— N(y) S$ N(x — y). 


Interchanging x and y yields 
N(y) — N(x) < N(y — x). 


Since N(x — y) = N(y — x) (Definition 8.1.3(b) with wu = x — y anda = —1), the last 
two inequalities imply (8.1.2). q 


Metrics for R” 


In Section 5.1 we defined the norm of a vector X = (x1, X2,...,Xn) in R” as 


XI = (xe) 


i=1 
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The metric induced by this norm is 


1/2 
wos.) = (So - »”) 


i=1 


Whenever we write R” without identifying the norm or metric specifically, we are referring 
to IR” with this norm and this induced metric. 


The following definition provides infinitely many norms and metrics on R”. 


Definition 8.1.6 If p > 1 and X = (x1, X2,..., Xn), let 


n 1/p 
IXIlp = i nl?) ; (8.1.3) 


i=1 


The metric induced on R” by this norm is 


n 1/p 
pp(X, Y) = (> |xi — vi] . a 


i=1 


To justify this definition, we must verify that (8.1.3) actually defines a norm. Since it is 
clear that ||X||, > 0 with equality if and only if X = 0, and ||aX||p = |a|||X||p if a is any 
real number and X € R”, this reduces to showing that 


IX+¥llp < [Xllp + IYI (8.1.4) 
for every X and Y in R”. Since 
lxi + vil S [ail + lil, 


summing both sides of this equation fromi = | ton yields (8.1.4) with p = 1. To handle 
the case where p > 1, we need the following lemmas. The inequality established in the 
first lemma is known as Hoélder’s inequality. 


Lemma 8.1.7 Suppose that [11, [2,..., fn and V1, V2,..., Vy are nonnegative numbers. 
Let p > 1 andq = p/(p — 1); thus, 
1 1 
—-+-=1. (8.1.5) 
Po 


Then 
n n 1/p n 1/q 
Yo ivi < (> «] (> 1) . (8.1.6) 
i=1 i=l i=1 
Proof Let a and f be any two positive numbers, and consider the function 


f(b) = + ap. 
q 
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where we regard a as aconstant. Since f’(B) = 84-1! —a and f"(B) = (¢—1)B7? > 0 
for B > 0, f assumes its minimum value on [0, 00) at B = a!/@-) = qwP-!, But 


Dp (p—-1)4 1 1 
fr) == 4% -a? =a? (242-1) =0, 
P q Pp 4 


Therefore, 
aP Ba 
aB<—+— if a,p>0. (8.1.7) 
P q 
Now let 
—1/p —1/q 
n n 
jy = Lj ye and = 6; = v; be 
jJ=1 j=l 
From (8.1.7), 
; -1 a -1 
aps (yur) +t(yos 
j=l 4 \Ga 


From (8.1.5), summing this from 7 = | ton yields a a; Bj < 1, which implies (8.1.6). 
an] 


Lemma 8.1.8 (Minkowski’s Inequality) Suppose thatu,,u2,...,Un and v1, 
U2,--+, Un are nonnegative numbers and p > |. Then 


n 1/p n 1/p n 1/p 
(d2 + v0? = (3: t) + (>: vt) : (8.1.8) 
i=1 i=1 i=1 
Proof Again, letg = p/(p — 1). We write 
n n n 
Soi + 01)? = Youu + 04)? + Yo vu + 0;)P 1. (8.1.9) 
i=1 i=1 i=1 


From Hélder’s inequality with w; = u; and v; = (u; + v;)?~1, 
n n 1/p n 1/q 
So ui (ui +0)?! < (>: t) (S30 + »9?) : (8.1.10) 
i=] i=1 i=1 

since g(p — 1) = p. Similarly, 


n n 1/p n 1/q 
Yo vi (ui +)?! < (> vt) (2 + »)? . 


i=1 i=1 i=1 


This, (8.1.9), and (8.1.10) imply that 


n n 1/p n 1/p n 1/q 
Sui +0)? < (> ) + (> vt) (Se + »? : 


i=1 i=1 i=1 i=1 
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Since 1 — 1/q = 1/p, this implies (8.1.8), which is known as Minkowski’s inequality. T 
We leave it to you to verify that Minkowski’s inequality implies (8.1.4) if p > 1. 


We now define the oo-norm on R” by 
|Xlloo = max {|x;||1 <i <n}. (8.1.11) 


We leave it to you to verify (Exercise 8.1.15) that || - ||oo is anorm on R”. The associated 
metric is 
Poo(X, Y) = max {|x; — yi| | 1<i<n}. 


The following theorem justifies the notation in (8.1.11). 


Theorem 8.1.9 /fX € R" and p2 > p; = 1, then 


XIlp2 < /Xllp.: (8.1.12) 
moreover, 
lim ||X||p = max {|x;||1 <i <n}. (8.1.13) 
poo 
Proof Let 1, v2,..., U, be nonnegative and M = max {u; | 1l<i< n\. Define 


n 1/p 
o(p) = (>: t) ; 


i=1 


Since u;/o(p) < Land p2 > pi, 


Uj Pl Uj P2 
(545) ~ (45) 


«oD n ye Se 1/p1 n ue \?2 1/pi 
= : i = 1, 
o(p2) (> Cay, - (2 ea) 


so o(p1) = o(p2). Since M < o(p) < Mn!/?, limp-+o0 o(p) = M. Letting u; = |x; | 
yields (8.1.12) and (8.1.13). aa 


Since Minkowski’s inequality is false if p < 1 (Exercise 8.1.19), (8.1.3) is not a norm in 
this case. However, if 0 < p < 1, then 


n 
IXIp = do ail? 


i=1 


therefore, 


is anorm on R” (Exercise 8.1.20). 


Vector Spaces of Sequences of Real Numbers 


In this section and in the exercises we will consider subsets of the vector space R®™ con- 
sisting of sequences X = {x;}?2,, with vector addition and scalar multiplication defined 
by 

X+Y={xj+ yi}, and rX = {rx }P2,. 
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Example 8.1.3 Suppose that 1 < p < oo and let 


[o.@) 
i= Xe R™| ya <2 : 
i=l 
Let 
00 1/p 
Xllp = (>: nt?) . 
i=l 
Show that (£, || - ||») is a normed vector space. 


Solution Suppose that X, Y € £,. From Minkowski’s inequality, 
n 1/p n 1/p n 1/p 
(Yoho + nt") = (dor + (Som) 
i=l i=l i=l 

for each n. Since the right side remains bounded as n — oo, so does the left, and 

foe) 1/p (oe) 1/p Co 1/p 

(> |xj + ni?) < (> nl?) ~ (> pi") (8.1.14) 
i=l i=l i=1 


soX+Y € £,. Therefore, £, is closed under vector addition. Since £, is obviously closed 


under scalar multiplication, £, is a vector space, and (8.1.14) implies that || - ||, is a norm 
on fp. a 
The metric induced by || - || p is 


00 1/p 
pp(X, Y) = (>: Xi - vt) ; 


i=1 
Henceforth, we will denote (£5, || - ||») simply by >. 
Example 8.1.4 Let 


loo = {K € R®™ | {x;}?2, is bounded} . 


Let 
Xlloo = sup {|i| |i = 1}. 
We leave it to you (Exercise 8.1.26) to show that (€g0, || - loo) is a normed vector space. I 
The metric induced by || - ||oo is 


Poo(X, Y) = sup {[xi — yil |i = 1}. 


Henceforth, we will denote (£0, || - |loo) simply by Loo. 


Section 8.1 Introduction to Metric Spaces 525 


Familiar Definitions and Theorems 


At this point you may want to review Definition 1.3.1 and Exercises 1.3.6 and 1.3.7, which 
apply equally well to subsets of a metric space (A, p). 


We will now state some definitions and theorems for a general metric space (A, p) that 
are analogous to definitions and theorems presented in Section 1.3 for the real numbers. To 
avoid repetition, it is to be understood in all these definitions that we are discussing a given 
metric space (A, p). 


Definition 8.1.10 If wo € A and e > 0, the set 
Ne(uo) = {u eA | p(uo, u)< e} 


is called an €-neighborhood of ug. (Sometimes we call S, the open ball of radius € centered 
at ug.) If a subset S of A contains an €-neighborhood of uo, then S is a neighborhood of 
Ug, and uo is an interior point of S. The set of interior points of S is the interior of S, 
denoted by S°. If every point of S is an interior point (that is, S° = $), then S is open. A 
set S is closed if S° is open. 


Example 8.1.5 Show that ifr > 0, then the open ball 
S;(uo) = {u EA | p(uo,u) < r} 


is an open set. 


Solution We must show that if uw; € S;(vo), then there is an € > 0 such that 
Se(ui) C S;(uo). (8.1.15) 
If uw; € S;(uo), then p(u1, vo) < r. Since 


p(u, uo) S pu, U1) + pli, Uo) 


for any uw in A, p(u,uo) < r if p(u,u1) < r — p(uy,U0). Therefore, (8.1.15) holds if 
€ <r—p(uy, Uo). | 

The entire space A is open and therefore 4 (= A‘) is closed. However, @ is also open, 
for to deny this is to say that it contains a point that is not an interior point, which is absurd 
because @ contains no points. Since 9 is open, A (= 9°) is closed. If A = R, these are the 
only sets that are both open and closed, but this is not so in all metric spaces. For example, 
if p is the discrete metric, then every subset of A is both open and closed. (Verify!) 


A deleted neighborhood of a point ug is a set that contains every point of some neigh- 
borhood of uo except uo itself. (If p is the discrete metric then the empty set is a deleted 
neighborhood of every member of A!) 


The proof of the following theorem is identical to the proof Theorem 1.3.3. 
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Theorem 8.1.11 
(a) The union of open sets is open. 


(b) The intersection of closed sets is closed. 


Definition 8.1.12 Let S be a subset of A. Then 
(a) wo isa limit point of S if every deleted neighborhood of wo contains a point of S. 


(b) wo is a boundary point of S if every neighborhood of uo contains at least one point 
in S and one not in S. The set of boundary points of S is the boundary of S, denoted 
by 0S. The closure of S, denoted by S, is defined by S = S UOS. 


(c) Uo is an isolated point of S if uo € S and there is a neighborhood of uo that contains 
no other point of S. 


(d) wo is exterior to S if uo is in the interior of S°. The collection of such points is the 
exterior of S. Hi 


Although this definition is identical to Definition 1.3.4, you should not assume that con- 
clusions valid for the real numbers are necessarily valid in all metric spaces. For example, 
if A = R and p(u, v) = |u — v|, then 


S,(uo) = {u | p(u, uo) < ae 


This is not true in every metric space (Exercise 8.1.6). 


For the proof of the following theorem, see the proofs of Theorem 1.3.5 and Corol- 
lary 1.3.6. 


Theorem 8.1.13 A set is closed if and only if it contains all its limit points. 


Completeness 


Since metric spaces are not ordered, concepts and results concerning the real numbers that 
depend on order for their definitions must be redefined and reexamined in the context of 
metric spaces. The first example of this kind is completeness. To discuss this concept, we 
begin by defining an infinite sequence (more briefly, a sequence) in a metric space (A, p) as 
a function defined on the integers n > k with values in A. As we did for real sequences, we 
denote a sequence in A by, for example, {up} = {uUn}°2,. A subsequence of a sequence 
in A is defined in exactly the same way as a subsequence of a sequence of real numbers 
(Definition 4.2.1). 


Definition 8.1.14 A sequence {u,,} in a metric space (A, p) converges tou € A if 
lim p(up,u) = 0. (8.1.16) 
n—->oo 
In this case we say that limy—oo Un = U. | 


We leave the proof of the following theorem to you. (See the proofs of Theorems 4.1.2 
and 4.2.2.) 
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Theorem 8.1.15 
(a) The limit of a convergent sequence is unique. 


(b) Jf limnoo Un = u, then every subsequence of {un} converges to u. 


Definition 8.1.16 A sequence {u,,} in a metric space (A, p) is a Cauchy sequence if 
for every € > 0 there is an integer N such that 


P(Un,Um)<e€ and m,n>N, (8.1.17) 
|_| 


We note that if o is the metric induced by a norm || - || on A, then (8.1.16) and (8.1.17) 
can be replaced by 
lim ||u, —ul| = 0 
n—-oo 


and 
lun —Um||<e€ and m,n>N, 


respectively. 


Theorem 8.1.17 Ifa sequence {uy} in a metric space (A, p) is convergent, then it is 
a Cauchy sequence. 


Proof Suppose that lim,-..u, = u. If € > 0, there is an integer N such that 
p(un,u) < €/2ifn > N. Therefore, if m,n > N, then 


P(Un, Um) < P(Un, U) + p(u, Um) < €. an 


Definition 8.1.18 A metric space (A, p) is complete if every Cauchy sequence in A 
has a limit. 


Example 8.1.6 Theorem 4.1.13 implies that the set R of real numbers with p(u, v) 
= |u — v| is a complete metric space. a 


This example raises a question that we should resolve before going further. In Section 1.1 
we defined completeness to mean that the real numbers have the following property: 


Axiom (I). Every nonempty set of real numbers that is bounded above has a supremum. 


Here we are saying that the real numbers are complete because every Cauchy sequence 
of real numbers has a limit. We will now show that these two usages of “complete” are 
consistent. 


The proof of Theorem 4.1.13 requires the existence of the (finite) limits inferior and 
superior of a bounded sequence of real numbers, a consequence of Axiom (I). However, 
the assertion in Axiom (I) can be deduced as a theorem if Axiom (I) is replaced by the 
assumption that every Cauchy sequence of real numbers has a limit. To see this, let T be a 
nonempty set of real numbers that is bounded above. We first show that there are sequences 
{uj}, and {v;}°2, with the following properties for alli > 1: 
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(a) u; <¢tforsomet € T and y; > t for allt € T; 
(b) (vj —ui) < 2'"*(1 — U1). 
(c) uz <ujsi < Vidi < Yj 


Since T is nonempty and bounded above, u; and v; can be chosen to satisfy (a) with 
i = 1. Clearly, (b) holds withi = 1. Let wy = (uw; + v1)/2, and let 


ints = (w1,v1) if w, <tforsomet € T, 
20?" V(ui1,w1) ifw, >t forallt eT. 


In either case, (a) and (b) hold with 7 = 2 and (c) holds with i = 1. Now suppose that 
n > 1 and {u1,...,Un} and {v1,..., Un} have been chosen so that (a) and (b) hold for 
1 <i <nand (c) holds for 1 <i <n —1. Let wy = (Un + Un)/2 and let 


(u je (Wn,Un) ifw, <tforsomet €T, 

nto "ntl! V(un, Wn) if w, >t forallt € T. 
Then (a) and (b) hold for 1 < i < n + 1 and (c) holds for 1 <i <n. This completes 
the induction. 


Now (b) and (c) imply that 


O<ujgi—ui <2''(u —u1) and O< vj; -vj41 <2' 11-1), i> 1. 
By an argument similar to the one used in Example 4.1.14, this implies that {u;}?2, and 
{uj }?2, are Cauchy sequences. Therefore the sequences both converge (because of our 
assumption), and (b) implies that they have the same limit. Let 

lim u; = lim v; = B. 

1—>co 1—>co 
Ift € T, then v; > ¢ for alli, so 6 = limj..9 v; = t; therefore, 6 is an upper bound of 
T. Now suppose that € > 0. Then there is an integer N such that uy > 6 —«. From the 
definition of uy, there is aty in 7 such that ty > uy > 6 —€. Therefore, B = supT. U 


Example 8.1.7 (The Metric Space C[a,b]) Let C [a,b] denote the set of all 
real-valued functions f continuous on the finite closed interval [a, b]. From Theorem 2.2.9, 
the quantity 


| fll = max {|fO)| a <x <b} 


is well defined. We leave it to you to verify that it is a norm on C[a, b]. The metric induced 
by this norm is 


p(f.8) = If —gll = max {| f(x) — g@)||a <x <d}. 


Whenever we refer to C[a,b], we mean this metric space or, equivalently, this normed 
linear space. | 

From Theorem 4.4.6, a Cauchy sequence { f,} in C[a, b] converges uniformly to a func- 
tion f on [a, b], and Corollary 4.4.8 implies that f is in C[a, b]; hence, C [a, b] is complete. 
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The Principle of Nested Sets 
We say that a sequence {7,,} of sets is nested if T,41 C Ty, for all n. 


Theorem 8.1.19 (The Principle of Nested Sets) A metric space (A, p) is 
complete if and only if every nested sequence {Tn} of nonempty closed subsets of A such 
that limyp—+oo d(T) = 0 has a nonempty intersection. 


Proof Suppose that (A, e) is complete and {T,,} is a nested sequence of nonempty 
closed subsets of A such that lim, d(T, ) = 0. For each n, choose t, € T,. If m > n, 
then tm, tn € Tn, SO P(tn,tm) < d(Ty). Since limp+oo d(Tn) = 0, {tn} is a Cauchy se- 
quence. Therefore, limy—+oo tn = f exists. Since f is a limit point of T,, and T;, is closed 
for alln, ft € T, for alln. Therefore, f € NP2, Th; in fact, NPL, Tn = {ft}. (Why?) 

Now suppose that (A, p) is not complete, and let {t,} be a Cauchy sequence in A that 
does not have a limit. Choose n; so that p(tn,t,) < 1/2 ifn > my, and let T) = 
{t | P(t, tn,) < 1}. Now suppose that 7 > 1 and we have specified m1, n2, ..., Nj-1 
and 7), 72, ..., Tj-1. Choose n; > nj, so that P(tn, tn; ) <2/ ifn > nj;, and let 
T; = {t | o(t. tn;) < a-+1). Then 7; is closed and nonempty, 7j+1; C T; for all j, 
and limj—oo d(T;) = 0. Moreover, t, € Tj ifn > nj. Therefore, iff € (eae fs 
then p(tn.f) < 2/,n>n j» 80 liMy+ootn = f, contrary to our assumption. Hence, 
(eg Tj; =@. 


Equivalent Metrics 


When considering more than one metric on a given set A we must be careful, for example, 
in saying that a set is open, or that a sequence converges, etc., since the truth or falsity of 
the statement will in general depend on the metric as well as the set on which it is imposed. 
In this situation we will alway refer to the metric space by its “full name;" that is, (A, p) 
rather than just A. 


Definition 8.1.20 If o and o are both metrics on a set A, then p and o are equivalent 
if there are positive constants w and 6 such that 


a< pt, y) <p forall x,ye¢@A suchthat xy. (8.1.18) 
a(x, y) 


Theorem 8.1.21 If pando are equivalent metrics ona set A, then (A, p) and (A, 0) 
have the same open sets. 


Proof Suppose that (8.1.18) holds. Let S be an open set in (A, p) and let x9 € S. Then 
there is ane > 0 such that x € S if p(x,xo) < €, so the second inequality in (8.1.18) 
implies that x9 € S if o(x, xo) < €/B. Therefore, S is open in (A, 0). 

Conversely, suppose that S is open in (A,o) and let x9 € S. Then there is ane > 0 
such that x € S if o(x, x0) < €, so the first inequality in (8.1.18) implies that x9 € S if 
p(x, Xo) < €a. Therefore, S is open in (A, p). 0 


530 Chapter 8 Metric Spaces 


Theorem 8.1.22 Any two norms N, and N2 on R" induce equivalent metrics on R". 


Proof It suffices to show that there are positive constants a and 6 such 


N(X) ; 
a< No(X) <p if X40. (8.1.19) 


We will show that if N is any norm on R”, there are positive constants ay and by such 
that 
an||Xll2 < N(X) <bw|[X|l2 if X40 (8.1.20) 


and leave it to you to verify that this implies (8.1.19) witha = ay, /by, and B = by, /anp. 


We write X — Y = (x1, X2,...,Xn) as 
n 
X-Y¥=)0 @ - Ei, 
i=l 
where E; is the vector with ith component equal to 1 and all other components equal to 0. 
From Definition 8.1.3(b), (c), and induction, 
n 
N(K-Y) < [xi — vil NED; 
i=1 
therefore, by Schwarz’s inequality, 
N(X—-Y) < K||X—-Yl2, (8.1.21) 


where 


ji 1/2 
K= (> a) : 
i=1 
From (8.1.21) and Theorem 8.1.5, 
|N(X) — N(Y)| < K||X—Yllo, 


so N is continuous on R5 = R”. By Theorem 5.2.12, there are vectors U; and U2 such 
that ||Ui|/2 = ||U2||2 = 1, 


N(U;) = min {N(U)| |Ulj2 = 1}, and = N(U2) = max {N(U) | ||Ul]2 = 1}. 


Ifay = N(U;) and by = N(U2), then ay and by are positive (Definition 8.1.3(a)), and 


».¢ 
ay sn (Z-) <bn if xX £0. 
I|X|l2 


This and Definition 8.1.3(b) imply (8.1.20). a 


We leave the proof of the following theorem to you. 
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Theorem 8.1.23 Suppose that p and o are equivalent metrics on A. Then 


(a) A sequence {un} converges to u in (A, p) if and only if it converges to u in (A, 0). 


(b) A sequence {uy} is a Cauchy sequence in (A, p) ifand only if it is a Cauchy sequence 


(c) 


in (A,o). 
(A, p) is complete if and only if (A, 0) is complete. 


8.1 Exercises 


Show that (a), (b), and (c) of Definition 8.1.1 are equivalent to 
(i) p(u, v) = Oif and only ifu = v; 
(ii) p(u,v) < p(w, u) + p(w, v). 


Prove: If x, y, u, and v are arbitrary members of a metric space (A, p), then 
le(x, ¥) — plu, v)| < p(x, u) + plv, y). 


(a) Suppose that (A, p) is a metric space, and define 


plu, v) 


PS TE plo) 


Show that (A, p1) is a metric space. 


(b) Show that infinitely many metrics can be defined on any set A with more than 
one member. 


Let (A, p) be a metric space, and let 


_ pu.) 
o(u,v) = ————_.. 
1+ p(u, v) 

Show that a subset of A is open in (A, p) if and only if it is open in (A, 0). 


Show that if A is an arbitrary nonempty set, then 


0 ifv=u, 
PO) Grebe 
is a metric on A. 
Suppose that (A, p) is a metric space, Uo € A, andr > 0. 
(a) Show that S;, (uo) C {u | p(u,uo) < r} if A contains more than one point. 
(b) Verify that if p is the discrete metric, then Sj (uo) # {w| p(u,uo) < 1}. 
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10. 


12. 


13. 


14. 


15. 


16. 
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Prove: 

(a) The intersection of finitely many open sets is open. 

(b) The union of finitely many closed sets is closed. 

Prove: 

(a) If U is a neighborhood of up and U C V, then V is a neighborhood of uo. 
(b) If Uj, U2, ..., Up are neighborhoods of ug, so is N?_, Uj. 

Prove: A limit point of a set S is either an interior point or a boundary point of S. 
Prove: An isolated point of S is a boundary point of S°. 

Prove: 

(a) A boundary point of a set S is either a limit point or an isolated point of S. 
(b) A set S is closed if and only if S = S. 

Let S be an arbitrary set. Prove: (a) 0S is closed. (b) S° is open. (c) The exterior 
of S is open. (d) The limit points of S form a closed set. (e) (Ss) = 5. 


Prove: 

(a) ($1 N S2)° = s? nN SS (b) St U Sf C (S$; U S2)° 
Prove: 

(a) 0(S1 U Sz) C 0S; UAS2 (b) (81 N Sz) C AS; U IS. 
(c) dS cas (d) aS = 0S¢ 

(e) aS —T) CaS U0T 

Show that 


|X|] = max{|x1], |x2|,.--, |Xnl} 
is anorm on R”. 
Suppose that (4;, p;), 1 <i <k, are metric spaces. Let 
A= A, x Ad X++X Ap = {X = (x1, %2,---,%k) | x € Aj, 1<i <k}. 
If X and Y are in A, let 


k 
p(X, ¥) = > pai. yi). 


i=1 


(a) Show that p is a metric on A. 


17. 


18. 
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(b) Let {X,}92, = {(v1r, X2r,---,Xkr) $22, be a sequence in A. Show that 


r=1 —_ 


lim X;- =X= (X1,%2,..., Xx) 
roo 
if and only if 
lim xj, =X;, 1<i<k 
roo 


(c) Show that {X,}02, is a Cauchy sequence in (A, p) if and only if {x;,}92, isa 
Cauchy sequence in (A;, p;), 1 <i <k. 

(d) Show that (A, p) is complete if and only if (A;, p;) is complete, 1 <i <k. 

For each positive integer i, let (Ai, 0;) be a metric space. Let A be the set of all 

objects of the form X = (x1, X2,...,Xn,...), where x; € A;,i > 1. (For example, 

if A; = R,i > 1, then A = R©.) Let {a7;}°2, be any sequence of positive numbers 

such that }7?°, aj < 00. 

(a) Show that 


[o) 


pili, Yi) 
(CYS) aes 
d "1+ pi(xi, vi) 
is ametric on A. 
(b) Let {X,}92, = {vir Xor,...,Xnr,---)}2L, be a sequence in A. Show that 
lim X, = X = (&1,%2,...,¥n,---) 
roo 


if and only if 
lim xj, =X;, i> 1. 
r>oo 
(c) Show that {X,}°2, is a Cauchy sequence in (A, p) if and only if {x;,}02, isa 
Cauchy sequence in (A;, p;) for alli > 1. 
(d) Show that (A, p) is complete if and only if (A;, p;) is complete for all i > 1. 
Let C[0, co) be the set of all real-valued functions continuous on [0, 00). For each 
nonnegative integer n, let 


If ln = max {| f(x)||0<x <n} 


om lf all 
_ = glln 
oa Sees eer 
Define 
| 
PL.) =D) sap Pal f8): 
n=1 


(a) Show that p is a metric on C[0, 00). 
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(b) Let { fc }f2, be a sequence of functions in C[0, 00). Show that 
lim fx = f 
k->oo 
in the sense of Definition 8.1.14 if and only if 
lim f(x) = f(x) 
k->oo 


uniformly on every finite subinterval of [0, 00). 
(c) Show that (C[0, oo), p) is complete. 
19. Show that Minkowski’s inequality is false if 0 < p < 1. 
20. Suppose that 0 < p < 1. Show that if uw and v are nonnegative, then 


(u+v)? <u? +0?. 


Use this to show that if X, Y € R”, 


p(X) = Do ixil?, and p(¥) = So |yil?. 


i=1 i=1 
then 
P(X + Y) < p(X) + p(Y). 
Is p anorm on R”? 
21. Suppose that X = {x;}%2, isin £,, where p > 1. Show that 
(a) Xe 4, forallr > p; 
(b) ifr > p, then |X|, < IXllp: 
(c) limpo0 [|X] = ||Xlloo. 
22. Let (A, p) be a metric space. 
(a) Suppose that {u,} and {v,} are sequences in A, limp—+o0 Un = U, and limy—+o0 Un = 
v. Show that limy—+o0 P(Un, Un) = p(u, v). 
(b) Conclude from (b) that if limp+ooU, = u and v is arbitrary in A, then 
limp—+oo P(Un, Vv) = plu, v). 


23. Prove: If {w,;}02, is a Cauchy sequence in a normed vector space (A, || - ||), then 
{|lu,||}22, is bounded. 
24. Let 


CO 
A=*XeR@® | the partial sums > x;,n > 1, are bound . 
i=l 
(a) Show that 
n 
oxi 


i=1 


||X|| = sup 


n>1 


is anorm on A. 
(b) Let p(X, Y) = ||X — Y||. Show that (A, p) is complete. 
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25. (a) Show that 
b 
vi= f Ifooy|dx 


is anorm on Ca, b], 
(b) Show that the sequence { f,,} defined by 


fats) = (=) 


a 


is a Cauchy sequence in (C [a, 5], || - ||). 
(c) Show that (C[a, b], || - ||) is not complete. 
26. (a) Verify that £.. is a normed vector space. 
(b) Show that £. is complete. 
27. Let A be the subset of R© consisting of convergent sequences X = {x;}?2,. Define 
\|X|| = sup;>1 |x; |. Show that (A, || - ||) is a complete normed vector space. 


28. Let A be the subset of R® consisting of sequences X = {x;}°2, such that limj—,9. xj = 
0. Define ||X|| = max {|xi| | i= 1}. Show that (A, ||-|]) is a complete normed vector 
space. 

29. (a) Show that R¥, is complete if p > 1. 

(b) Show that £, is complete if p > 1. 

30. Show that if X = {x;}2, € £p and Y = {y;}%, © €g, where 1/p + 1/q = 1, 

then Z = {x;y;} € 1. 


8.2 COMPACT SETS IN A METRIC SPACE 


Throughout this section it is to be understood that (A, p) is a metric space and that the sets 
under consideration are subsets of A. 

We say that a collection J€ of open subsets of A is an open covering of T if T C 
U {H | Hex i We say that T has the Heine—Borel property if every open covering Jt 


of T contains a finite collection # such that 


ToulH|He Rl. 


From Theorem 1.3.7, every nonempty closed and bounded subset of the real numbers 
has the Heine—Borel property. Moreover, from Exercise 1.3.21, any nonempty set of reals 
that has the Heine—Borel property is closed and bounded. Given these results, we defined 
a compact set of reals to be a closed and bounded set, and we now draw the following 
conclusion: 


A nonempty set of real numbers has the Heine-Borel property if and only if it is compact. 
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The definition of boundedness of a set of real numbers is based on the ordering of the 
real numbers: if a and b are distinct real numbers then either a < b or b < a. Since there 
is no such ordering in a general metric space, we introduce the following definition. 


Definition 8.2.1 The diameter of a nonempty subset S of A is 
d(S) = sup {o(u, v) | U,vE T} : 
If d(S) < oo then S is bounded. a 


As we will see below, a closed and bounded subset of a general metric space may fail 
to have the Heine—Borel property. Since we want “compact” and “has the Heine—Borel 
property" to be synonymous in connection with a general metric space, we simply make 
the following definition. 


Definition 8.2.2 A set T is compact if it has the Heine—Borel property. 


Theorem 8.2.3 An infinite subset T of A is compact if and only if every infinite subset 
of T has a limit point in T. 


Proof Suppose that T has an infinite subset E with no limit point in T. Then, if t € T, 
there is an open set H; such that t € H; and H; contains at most one member of EF’. Then 
HH =U {H; | te T} is an open covering of T,, but no finite collection {H;,, H1,,..., Hr, } 
of sets from # can cover E, since E is infinite. Therefore, no such collection can cover T; 
that is, T is not compact. 


Now suppose that every infinite subset of T has a limit point in 7, and let J€ be an open 
covering of 7. We first show that there is a sequence {H;}°°, of sets from # that covers 
T. 


If € > 0, then T can be covered by €-neighborhoods of finitely many points of T. We 
prove this by contradiction. Let t; € T. If N¢(t,) does not cover T, there is a t2 € T such 
that p(t1, 2) = €. Now suppose that n > 2 and we have chosen fy, f2, ..., t, such that 
p(ti,tj) > 6,1 <i < j <n. IfU?_, Ne(t;) does not cover T, there is a t4, € T such 
that p(tj,t4+1) > €, 1 <i <n. Therefore, p(t;,t;) > ¢€,1 <i < j <n+1. Hence, 
by induction, if no finite collection of €-neighborhoods of points in T covers T, there is an 
infinite sequence {f,}°2, in T such that p(t;,t;) = €,i 4 j. Such a sequence could not 
have a limit point, contrary to our assumption. 


By taking € successively equal to 1, 1/2,..., 1/n,..., we can now conclude that, for 
each n, there are points fin, fon, ..., tk,,,n Such that 


kn 
TC 'e N1/n(tin)- 


i=l 
Denote Bin = Ni/n(tin), 1 <i <n,n = 1, and define 


{G1, G2, G3, es = {Bi, sine ad Bry By, on Byes Bxo,25 By3, ee) Bx,3; sets e 
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If t € T, there is an H in # such that t € H. Since A is open, there is an € > 0 such 
that N.(t) C H. Since t € G; for infinitely many values of j and lim; d(G;) = 0, 


G; CN.(t) CH 


for some j. Therefore, if {G;,}?2, is the subsequence of {G;} such that G;, is a subset of 
some H; in # (the {H;} are not necessarily distinct), then 


Tc\ JH. (8.2.1) 


i=l 
We will now show that 


N 
ToUm. (8.2.2) 
i=1 


for some integer NV. If this is not so, there is an infinite sequence {f,}°°., in T such that 


mé\JHi. n=. (8.2.3) 


i=1 


From our assumption, {t,}°°, has a limit 7 in T. From (8.2.1), f € Hx for some k, so 
Ne(t) C Hx for some € > 0. Since limy+oo tn = f, there is an integer N such that 


n 
tr © Ne) C Ay C|_) Hi, n>k, 
i=l 
which contradicts (8.2.3). This verifies (8.2.2), so T is compact. aa] 


Any finite subset of a metric space obviously has the Heine—Borel property and is there- 
fore compact. Since Theorem 8.2.3 does not deal with finite sets, it is often more convenient 
to work with the following criterion for compactness, which is also applicable to finite sets. 


Theorem 8.2.4 A subset T of a metric A is compact if and only if every infinite se- 
quence {tn} of members of T has a subsequence that converges to a member of T. 


Proof Suppose that T is compact and {t,} C T. If {t,} has only finitely many distinct 
terms, there is af in T such that ¢, = f for infinitely many values of n; if this is so for 
ny <n2 <-+-, then limj+oth, = f. If {t,} has infinitely many distinct terms, then {t,} 
has a limit point tinT, so there are integers ny < nz < --: such that p(t,;,0) < 1/j; 
therefore, limj—o0 tn put. 

Conversely, suppose that every sequence in T has a subsequence that converges to a limit 
in T. If S is an infinite subset of 7, we can choose a sequence {t,} of distinct points in 
S. By assumption, {t, } has a subsequence that converges to a member f of T. Since f is a 
limit point of {t,}, and therefore of T, T is compact. q 


Theorem 8.2.5 IfT is compact, then every Cauchy sequence {tn}°°, in T converges 
to a limit in T. 
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Proof By Theorem 8.2.4, {t,} has a subsequence {t, , } such that 
lim th, = € T. (8.2.4) 
jroo 

We will show that limy-+9 tn = f. 


Suppose that « > 0. Since {t,} is a Cauchy sequence, there is an integer NV such that 
P(tn,tm) <€,n >m => N. From (8.2.4), there is anm =n; > N such that p(tm,f) < €. 
Therefore, 

P(tn,t) < P(tn.tm) + Pltm,f) < 26, n>m. u 


Theorem 8.2.6 [fT is compact, then T is closed and bounded. 


Proof Suppose that f is a limit point of T. For each n, choose th Af € Byjn(f) NT. 
Then limy+oo tn = f. Since every subsequence of {f,} also converges to f, f € T, by 
Theorem 8.2.3. Therefore, T is closed. 


The family of unit open balls #€ = {Bi (t) | te T} is an open covering of 7’. Since T is 
compact, there are finitely many members f1, fo, ..., fp of T such that S$ C U5 =, Bi(t;). 
If wu and v are arbitrary members of T, then u € B,(t-) and v € Bi (ts) for some r and s in 
{1,2,...,n}, so 


plu, v) < plu, tr) + pltr, ts) + plts, v) 
<2+ ptr, ts) < 2+ max {p(t;,t))|1<i <j <n}. 


Therefore, T is bounded. au) 


The converse of Theorem 8.2.6 is false; for example, if A is any infinite set equipped 
with the discrete metric (Example 8.1.2.), then every subset of A is bounded and closed. 
However, if T is an infinite subset of A, then Jf = {{t} | te T\ is an open covering of 7, 
but no finite subfamily of J? covers T. 


Definition 8.2.7 A set T is totally bounded if for every « > 0 there is a finite set T, 
with the following property: if ¢ € T, there is ans € 7; such that p(s,t) < €. We say that 
T. is a finite €-net for T. | 


We leave it to you (Exercise 8.2.4) to show that every totally bounded set is bounded and 
that the converse is false. 


Theorem 8.2.8 [fT is compact, then T is totally bounded. 


Proof We will prove that if T is not totally bounded, then T is not compact. If T is not 
totally bounded, there is an € > 0 such that there is no finite €-net for T. Let t; ¢ JT. Then 
there must be a f2 in T such that p(t1,f2) > €. (If not, the singleton set {t;} would be a 
finite €«-net for T.) Now suppose that m > 2 and we have chosen 1, f2, ..., t, such that 
p(ti,t;) => €, 1 <i < j <n. Then there must bea t,41 € T such that p(tj,tn+41) > €, 
1 <i <n. (if not, {4, f,...,t,} would be a finite €-net for T.) Therefore, p(t;,t;) > €, 
1 <i <j <n+1. Hence, by induction, there is an infinite sequence {t, }°2., in T such 
that p(t;,t;) => €,i A j. Since such a sequence has no limit point, T is not compact, by 
Theorem 8.2.4. an] 
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Theorem 8.2.9 /f (A, p) is complete and T is closed and totally bounded, then T is 
compact. 


Proof Let S bean infinite subset of 7, and let {s;}92, be a sequence of distinct members 
of S. We will show that {s;}?2 , has a convergent subsequence. Since T is closed, the limit 
of this subsequence is in 7, which implies that T is compact, by Theorem 8.2.4. 

Forn > 1, let T)/, be a finite 1/n-net for T. Let {sjo}°2, = {s;}02,. Since 7) is 
finite and {sjo}%, is infinite, there must be a member f of 7) such that p(sj9,t1) < 1 
for infinitely many values of i. Let {s;;}92, be the subsequence of {s;9}?2, such that 
P(si1,t) <1. 

We continue by induction. Suppose that n > | and we have chosen an infinite subse- 
quence {Sjn—1}72, Of {Sin—2}P2,. Since T1/p is finite and {s;,,—1}°2, is infinite, there 
must be member ft, of Tj/, such that p(sjn-1,tn) < 1 /n for infinitely many values of 
i. Let {sjn}P2, be the subsequence of {8;,n,-1}02, such that p(sin,t) < 1/n. From the 
triangle inequality, 

P(Sin. Sjn) <2/n, i,f =1, n=l. (8.2.5) 


Now let 5; = sjj,i > 1. Then {5;}92, is an infinite sequence of members of T. Mo- 
roever, if i, 7 > n, then’; and sj are both included in {Sin} o> so (8.2.5) implies that 
p(Si, Sj) < 2/n; that is, {5;}?2, is a Cauchy sequence and therefore has a limit, since 
(A, p) is complete. 0 


Example 8.2.1 Let T be the subset of £5 such that |x;| < j,i > 1, where lim;—g9 [i 
0. Show that T is compact. 


Solution We will show that T is totally bounded in £99. Since £55 is complete (Exer- 
cise 8.1.26), Theorem 8.2.9 will then imply that T is compact. 


Let € > 0. Choose N so that x; < € ifi > N. Let = max {y;|1 <i <n} and let p 


be an integer such that pe > w. Let O, = {ri€ | rj = integer in[—p, pi}. Then the subset 
of £49 such that x; € Oc, 1 <i < N,andx; =0,i > N, isa finite ¢-net for 7. 


Compact Subsets of C[a, b] 


In Example 8.1.7 we showed that C [a, b] is a complete metric space under the metric 


o(f.8) = If —gll = max {| f(x) — g(x) |a <x <5}. 
We will now give necessary and sufficient conditions for a subset of C [a, b] to be compact. 
Definition 8.2.10 A subset T of C [a, b] is uniformly bounded if there is a constant M 


such that 
[f(x)|<M if a<x<b and feT. (8.2.6) 


A subset T of C[a, b] is equicontinuous if for each € > 0 there is a 6 > O such that 


|f(%1) — f(x2)| <€ if x1,x2 € [a,b], |x1—x2|<6, and feT. (8.2.7) 
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Theorem 2.2.8 implies that for each f in C[a, b] there is a constant M ¢ which depends 
on f , such that 
|\f(x)|< Myr if ax<x<b, 


and Theorem 2.2.12 implies that there is a constant 6 ¢ which depends on f and € such that 
If) — f@2)| Se if x1,x2 € [a,b] and |x; —x2| < dy. 


The difference in Definition 8.2.11 is that the same M and 6 apply to all f in T. 


Theorem 8.2.11 A nonempty subset T of C [a, b] is compact if and only if it is closed, 
uniformly bounded, and equicontinuous. 


Proof For necessity, suppose that T is compact. Then T is closed (Theorem 8.2.6) 
and totally bounded (Theorem 8.2.8). Therefore, if ¢ > 0, there is a finite subset T, = 
{£1, £2,---, EK} of Cla, b] such thatif f € T, then || f—g;|| < ¢ forsomei in {1,2,...,k}. 
If we temporarily let € = 1, this implies that 


IF= MF -s) + all sf —sill+ ig <si+ lel, 
which implies (8.2.6) with 
M = 1+ max {|[gi|||1 <i <&}. 


For (8.2.7), we again let € be arbitary, and write 


| f (x1) — f(x2)| < | £1) — gi 1)| + 181 (1) — 87 (X2)| + lei 2) — f(x2)I 
< |gi (x1) — gi (x2)| + 211 f - gill (8.2.8) 
< [gi (%1) — gi(X2)| + 2¢. 


Since each of the finitely many functions g1, go, ..., gx is uniformly continuous on [a, b] 
(Theorem 2.2.12), there is a 5 > O such that 


|gi(x1) — gia). <e€ if |x1—x2)<8, 1<is<k. 
This and (8.2.8) imply (8.2.7) with € replaced by 3e. Since this replacement is of no 


consequence, this proves necessity. 


For sufficiency, we will show that T is totally bounded. Since T is closed by assumption 
and C[a, b] is complete, Theorem 8.2.9 will then imply that T is compact. 

Let m and n be positive integers and let 

M 
&, =a+—(b—a), O<r<m, and jo. —n<s <n; 
m n 

that is, a = & < & <--- < & = bisa partition of [a, b] into subintervals of length 
(b —a)/m, and —M = nen < Nenti < +++ < Nn-1 < Nn = M is a partition of the 
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segment of the y-axis between y = —M and y = M into subsegments of length M/n. 
Let Smn be the subset of C [a, b] consisting of functions g such that 


{g(Eo), (61), ---, 8(Em)} C {N-n, N-n41 +++. Mn—1, Nn} 
and g is linear on [§;—1, &], 1 <i <m. Since there are only (m + 1)(2n + 1) points of the 
form (&,, 7s), Smn is a finite subset of C [a, b]. 


Now suppose that € > 0, and choose 6 > 0 to satisfy (8.2.7). Choose m and n so that 
(b—a)/m <6 and2M/n <e. If f is an arbitrary member of 7, there is a g in Smn such 
that 


lei) -— f)|<¢e, O<i<m. (8.2.9) 


If0<i<m-—1, 


lei) — gi 41) = le Ei) — FED) + (SE) — FEi40| + |FEi41) — 8 Ei41)|. (8.2.10) 
Since & 41 — & < 6, (8.2.7), (8.2.9), and (8.2.10) imply that 


le(&i) — g(§+41)| < 3. 


Therefore, 
Ig(E;) —g(x)| <3e, & <x < &a4, (8.2.11) 
since g is linear on [&;, +1]. 


Now let x be an arbitrary point in [a, b], and choose i so that x € [&;, & 41]. Then 


If@) — g@) S$ If) — FED + [FED — 8G + [sd — g@)I, 


so (8.2.7), (8.2.9), and (8.2.11) imply that | f(x) — g(x)| < 5€,a <x <b. Therefore, Sinn 
is a finite 5e-net for T, so T is totally bounded. 0 


Theorem 8.2.12 (Ascoli-Arzela Theorem) Suppose that F is an infinite uni- 
formly bounded and equicontinuous family of functions on [a, b]. Then there is a sequence 
{fn} in F that converges uniformly to a continuous function on |a, b]. 


Proof Let T be the closure of ¥; that is, f € T if and only if either f € T or f 
is the uniform limit of a sequence of members of #. Then T is also uniformly bounded 
and equicontinuous (verify), and T is closed. Hence, T is compact, by Theorem 8.2.12. 
Therefore, ¥ has a limit point in 7. (In this context, the limit point is a function f in 
T.) Since f is a limit point of ¥, there is for each integer n a function f, in ¥ such that 
| fn — f || < 1/n; that is { f,} converges uniformly to f on [a, d]. q 


8.2 Exercises 


1. Suppose that 7), T, ..., Tj; are compact sets in a metric space (A, ep). Show that 
UF T; is compact. 
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2. 


10. 


11. 


(a) Show that a closed subset of a compact set is compact. 
(b) Suppose that J is any collection of closed subsets of a metric space (A, p), 
and some T in T is compact. Show that N {T | Te T} is compact. 
(c) Show that if T is a collection of compact subsets of a metric space (A, p), 
then M {T | Te T} is compact. 
If S and 7 are nonempty subsets of a metric space (A, ¢), we define the distance 
from S to T by 
dist(S, 7) = inf {p(s,t)|s €S,t eT}. 


Show that if S and 7 are compact, then dist(S, 7) = p(s,t) for some s in S and 
some ¢ in 7’. 
(a) Show that every totally bounded set is bounded. 
(b) Let 
Sine 1 ifi =r, 
710 ifi ¥r, 


lee) 
i=1? 


and let T be the subset of .5 consisting of the sequences X, = {6;;} 
r > 1. Show that T is bounded, but not totally bounded. 


Let T be a compact subset of a metric space (A, p). Show that there are members 5 
and t of T such that d(s,f) = d(T). 


Let T be the subset of £; such that |x;| < ;,i > 1, where ear [Li < co. Show 
that T is compact. 


Let T be the subset of £2 such that |x;| < wi,i > 1, where 77° 1? < oo. Show 
that T is compact. 


Let S be a nonempty subset of a metric space (A, p) and let uo be an arbitrary 
member of A. Show that S is bounded if and only if D = {e(u, uo) | UE Ss} is 
bounded. 


Let (A, p) be a metric space. 


(a) Prove: If S is a bounded subset of A, then SS (closure of S'}) is bounded. Find 
d(S). 

(b) Prove: If every bounded closed subset of A is compact, then (A, p) is com- 
plete. 


Let (A, p) be the metric space defined in Exercise 8.1.16 Let 
T= Ti x Tp x--- x Th, 


where 7; C A; and T; #4 9,1 <i <k. Show that T is compact if and only 7; is 
compact for 1 <i <k. 


Let (A, p) be the metric space defined in Exercise 8.1.17. Let 


T=T, X To X+++X Ty Xe, 
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where 7; C A; and 7; 4 @,i > 1. Show that if T is compact, then 7; is compact 
for alli > 1. 


12. Let {7,}°2, be a sequence of nonempty closed sets of a metric space such that (a) 
T; is compact; (b) Tn41 C Tn, n = 1; and (C) limy+oo d(Tn) = 0. Show that 
M7, Tn contains exactly one member. 


8.3 CONTINUOUS FUNCTIONS ON METRIC SPACES 


In Chapter we studied real-valued functions defined on subsets of R”, and in Chapter 6.4. 
we studied functions defined on subsets of R” with values in R”. These are examples of 
functions defined on one metric space with values in another metric space.(Of course, the 
two spaces are the same ifm = m.) 


In this section we briefly consider functions defined on subsets of a metric space (A, p) 
with values in a metric space (B, a). We indicate that f is such a function by writing 


f : (A, p) > (B, 0). 
The domain and range of f are the sets 
Df = {u eA | flu) is defined} 
and 
Rr = {v eB | v = f(u) for some u in Dz\. 

Definition 8.3.1 We say that 

lim f(u) =v 

usu 
if@ € Dy and for each € > 0 there is ad > O such that 


o(f(u),v)<e if weDy and 0<p(u,u) <6. (8.3.1) 


Definition 8.3.2 We say that f is continuous at u if uv € D - and for each € > 0 there 
isad > 0 such that 


o(f(u), f@))<e if we De ONs(u). (8.3.2) 
If f is continuous at every point of a set S, then f is continuous on S. | 


Note that (8.3.2) can be written as 


f(D¢ ONs(U)) C Ne(f@)). 


Also, f is automatically continuous at every isolated point of D ¢. (Why?) 


544 Chapter 8 Metric Spaces 


Example 8.3.1 If (A, || - ||) is a normed vector space, then Theorem 8.3.5 implies that 
F(u) = |l|ul| is a continuous function from (A, p) to R, since 

[lll] — [lal] < lu — I. 
Here we are applying Definition 8.3.2 with p(u,#) = ||u —@|| and o(v, ¥) = |v — TI. 


Theorem 8.3.3 Suppose thatt € D+. Then 


lim f(u) =v (8.3.3) 
uu 
if and only if 
lim f(u,) =O (8.3.4) 
n-oo 
for every sequence {un} in D ¢ such that 
lim uy, = U. (8.3.5) 
n—-oo 


Proof Suppose that (8.3.3) is true, and let {w,} be a sequence in Df that satisfies 
(8.3.5). Let € > 0 and choose 6 > 0 to satisfy (8.3.1). From (8.3.5), there is an inte- 
ger N such that p(uyn,”) < 6 ifn > N. Therefore, o(f(un),0) < € ifn > N, which 
implies (8.3.4). 


For the converse, suppose that (8.3.3) is false. Then there is an €9 > O and a sequence 
{un} in Dy such that p(un,”) < 1/n and o( f (un), V) = €0, so (8.3.4) is false. aa] 


We leave the proof of the next two theorems to you. 


Theorem 8.3.4 A function f is continuous at U if and only if 


lim f(u) = f@). 


Theorem 8.3.5 A function f is continuous at ¥ if and only if 
lim fun) = f@) 
n—-oo 
whenever {un} is a sequence in D ¢ that converges to U. 
Theorem 8.3.6 /f f is continuous on a compact set T, then f(T) is compact. 


Proof Let {v,} be an infinite sequence in f(T). For eachn, vy = f (un) for some uy € 
T. Since T is compact, {u,} has a subsequence {u»;} such that limj+o0Un,; = WU € T 
(Theorem 8.2.4). From Theorem 8.3.5, limj+oo f(Un;) = J (iM); that is, limj—oo Un; = 
f (u#). Therefore, f(T) is compact, again by Theorem 8.2.4. q 


Definition 8.3.7 A function f is uniformly continuous ona subset S of D ¢ if for each 
€ > Othere is ad > O such that 


o(f(u), f(v)) <¢€ whenever p(u,v)<6 and u,veS. 
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Theorem 8.3.8 /f f is continuous on a compact set T, then f is uniformly continuous 
onT. 


Proof If f is not uniformly continuous on 7, then for some €9 > 0 there are sequences 
{uy} and {v,}in T such that p(uy, vn) < 1/n and 


o(f(un), f(Un)) = 0. (8.3.6) 


Since T is compact, {un} has a subsequence {u,,, } that converges to a limit # in T (Theo- 
rem 8.2.4). Since p(Un,. Un, ) < 1/nx, limg—+oo Un, = % also. Then 


lim f(un,) = lim f(vn,) = f@) 
k-oo k-oo 
(Theorem 8.3.5), which contradicts (8.3.6). an] 


Definition 8.3.9 If f : (A, p) > (A, p) is defined on all of A and there is a constant a 
in (0, 1) such that 


p(f(u), f(v)) <ap(u,v) forall (u,v) Ee Ax A, (8.3.7) 


then f is a contraction of (A, p). | 
We note that a contraction of (A, p) is uniformly continuous on A. 


Theorem 8.3.10 (Contraction Mapping Theorem) [/f f is a contraction 


of a complete metric space (A, p), then the equation 
f(u) =u (8.3.8) 


has a unique solution. 


Proof To see that (8.3.8) cannot have more than one solution, suppose that vu = f (2) 
and v = f(v). Then 


plu, v) = p(f(u), f(r). (8.3.9) 


However, (8.3.7) implies that 
p( fu), f(v)) < wptu, v). (8.3.10) 
Since (8.3.9) and (8.3.10) imply that 
p(u, v) < aptu, v) 


anda < 1, it follows that p(u, v) = 0. Hence u = v. 


We will now show that (8.3.8) has a solution. With vo arbitrary, define 
Un = f(Un-1), n>. (8.3.11) 
We will show that {u,,} converges. From (8.3.7) and (8.3.11), 


P(Un+1,Un) = p(f(un), f(Un-1)) < &p(Un, Un-1)- (8.3.12) 


546 Chapter 8 Metric Spaces 


The inequality 
PUn+1,Un) <a" p(uj,uo), n=O, (8.3.13) 


follows by induction from (8.3.12). Ifm > m, repeated application of the triangle inequality 
yields 
PUn,Um) S PUn, Un—1) + P(Un-1, Un—2) + +++ + P(Um4+1, Um), 
and (8.3.13) yields 
a” 


Pltn, tn) = pi. uo)e™ 1 bate ea) < rea 


Now it follows that 


pli. ¥o) ow 


1 if n,m>QN, 


pun, Um) < 


and, since limy+o a" = 0, {uy} is a Cauchy sequence. Since A is complete, {u,} has a 
limit 7. Since f is continuous at 7, 


f@) = lim f(un-1) = lim up = %, 
n—-oo n—-oo 
where Theorem 8.3.5 implies the first equality and (8.3.11) implies the second. aa] 
Example 8.3.2 Suppose that 4 = h(x) is continuous on [a,b], K = K(x, y) is con- 


tinuous on [a,b] x [a,b], and |K(x, y)| < M ifa < x,y < b. Show that if |A| < 
1/M(b — a) there is a unique u in C [a, b] such that 


b 
u(x) = h(x) + af K(x, y)u(y)dy, a<x <b. (8.3.14) 


(This is Fredholm’s integral equation .) 


Solution Let A be C[a, b], which is complete. If u € C[a, b], let f(u) = v, where 


b 
v(x) = A(x) + af K(x, y)u(y)dy, a<x<b. 


Since v € C[a, b], f : Cla, b] > C[a, b]. If uy, uz € C[a, b], then 


b 
no=we)Z al f KG: DileG) —nO)l a, 


so 
[v1 — val] S |AIM(b —a)|lui — ual. 


Since |A|M(b — a) < 1, f is acontraction. Hence, there is a unique u in C[a, b] such that 
F(u) = u. This u satisfies (8.3.14). 
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8.3 Exercises 


Suppose that f : (A,p) — (B,o) and D¢ = A. Show that the following state- 

ments are equivalent. 

(a) f is continuous on A. 

(b) If V is any open set in (B,o), then f—!(V) is open in (A, p). 

(c) If V is any closed set in (B,o), then f~!(V) is closed in (A, p). 

A metric space (A, p) is connected if A cannot be written as A = A; U Ao, where 

A, and Az are nonempty disjoint open sets. Suppose that (A, p) is connected and 

f : (A, p) = (B,c), where D¢ = A, Ry = B, and f is continuous on A. Show 

that (B, 0) is connected. 

Let f be a continuous real-valued function on a compact subset S of a metric space 

(A, pe). Let o be the usual metric on R; that is, o(x, y) = |x — y|. 

(a) Show that f is bounded on S. 

(b) Leta = infyes f(u) and B = sup,cs f(u). Show that there are points wy 
and uz in [a,b] such that f(u1) =a and f(u2) = B. 


Let f : (A,e) — (B,o) be continuous on a subset U of A. Let w be in U and 
define the real-valued function g : (A, p) > R by 


glu) =o(f(u), f@)), we. 


a ow that g is continuous on U. 
Show that g i i U 
(b) Show that if U is compact, then g is uniformly continuous on U. 
(c) Show that if U is compact, then there is a # € U such that g(u) < g(v), 
uceUu. 


Suppose that (A, p), (B, a), and (C, y) are metric spaces, and let 
f :(A,p) > (B,o) and g:(B,o) > (C,y), 


where Dy = A, Ry = Dg = B, and f and g are continuous. Define h : (A, p) > 
(C, y) by h(u) = g(f(u)). Show that h is continuous on A. 


Let (A, p) be the set of all bounded real-valued functions on a nonempty set S, 
with p(u,v) = supseg |u(s) — v(s)|. Let 51, s2, ..., 8% be members of S, and 
f(u) = g(u(s1), (sz), ..., u(sg)), Where g is real-valued and continuous on R*. 
Show that f is a continuous function from (A, p) to R. 

Let (A, p) be the set of all bounded real-valued functions on a nonempty set S, 
with p(u,v) = sup,eg |u(s) — v(s)|. Show that f(u) = infses u(s) and g(u) = 
SuP,egs U(s) are uniformly continuous functions from (A, p) to R. 


Let I[a, b] be the set of all real-valued functions that are Riemann integrable on 
[a, b], with p(u, v) = supgcy<p |U(x) — v(x)|. Show that f(u) = / u(x) dx isa 


a 
uniformly continuous function from J [a, b] to R. 
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Answers to Selected 
Exercises 


Section 1.1 pp. 9-10 


1.1.1 (p. 9) (a) 2max(a,b) (b)2min(a,b) (c) 4max(a,b,c) (d) 4min@a, b,c) 
1.1.5 (p. 9) (a) c (no); —1 (yes) (b) 3 (no); —3 (no) (c) V7 (yes); —V7 (yes) 
(d) 2 (no); -3 (no) (e) 1 (n0);—1 (no) (£) V7 (no); —V7 (no) 


Section 1.2 pp. 15-19 


1.2.9 (p. 16) (a) 2”/(2n)!  (b) 2-37/(2n+ 1)! (c) 2-7 Q2n)!/(~!)?_— (d) n/n! 
1.2.10 (p. 16) (b) no 1.2.11 (p. 16) (b) no 


x” SI 
1.2.20 (p. 18) An = T G -» ; 


jal 
1.2.21 (p. 18) fr(xi,%2,..., Xn) = 277! max(x1,%2,..., Xn), &n(X1,X2,---, Xn) = 
gn-l min(x1,X2,..., Xn) 


Section 1.3. pp. 27-29 


1.3.1 (p. 27) (a) (5. 1); (—oo, S)UlI, 00); (—00, gu, 00); (0, 3); (—00, OED 00); 
(—0o, 4] U [1, 00) (b) (—3, —2) U (2, 3); (—00, —3] U [-2, 2] U [3, 00); 8; (00, 00); 9; 
(—oo, —3] U [—2, 2] U [3, 00) (€) 8; (—00, 00); 8; (—00, 00); O; (—00, 00) 

(d) 9; (—00, 00); [-1, 1]; (00, -1) U (1, 00); [-1, 1]; (-09, 00) 

1.3.2 (p. 27) (a) (0,3] (b) [0.2] (c) (00, 1) U2,00)  (d) (cv, 0] U GB, 00) 
13.4 (p. 27) (a) + (b)t (c)6 (d)1 
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1.3.5 (p. 27) (a) neither; (—1,2) U (3,00); (—o0, -1) U (2,3); (-00, -1] U (2,3); 
(—oo, —1] U [2,3] (b) open; S; (1, 2); [1, 2] (c) closed; (—3, —2) U (7,8); (—o0, —3) U 
(—2, 7) U(8, co); (—co—3] U[—2, 7] U[8, 00) (d) closed; 8; UJ {(n, n+1) | n= integer}; 
(=06, oo) 

1.3.20 (p. 28) (a) {x |x =1/n, n =1,2,...}; (b) 9 (Cc), (d) S; = rationals, 
S» = irrationals (e) any set whose supremum is an isolated point of the set (f), (g) the 
rationals (h) S; = rationals, Sz = irrationals 


Section 2.1 pp. 48-53 


2.1.2 (p. 48) Dy = [-2,1)U [3,00), Dg = (—00, -3] U [3, 7) U (7,00), Dye = 
Dye = B.T)U (7,0), Dye = (3,4) U (4,7) U (7, 00) 

2.1.3 (p. 48) (a), (b) {x |x 4 (2k + 1)2/2 where k = integer} (c) {x |x 40,1} 
(d) {x|x #0} (e) [1, 00) 

2.1.4 (p. 49) (a) 4 (b) 12 (c)-1 (d)2 (e)-2 

2.1.6 (p. 49) (a)# (b)-% (c)4 (d)2 

2.1.7 (p. 49) (a) 0,2 (b)0,none (c)—4,4£ (d) none, 0 

2.1.15 (p. 50) (a)0 (b)0O (c)none (d)0 = (e) none (f) 0 

2.1.18 (p. 50) (a)0 (b)0O (c)none (d) none (e) none (f) 0 

2.1.20 (p. 50) (a) co ~=((b)-co (c)c (d)w (e) aw (f)-c« 

2.1.22 (p. 51) (a) none (b) oo (c)o (d) none 

2.1.24 (p. 51) (a) co (b)coo (c)co (d)-co (e)none (f) co 

2.1.31 (p. 52) (a)2 (b)2% (c)oo (d)-co (e)oo (f) 4 

2.1.32 (p. 52) limy+oor(x) = co ifn > mand an/bm > 0; = —oo ifn > m and 
an/bm <0; = an/bm ifn = m; = Oifn < Mm. limy-+—99 r(x) = (-1)"™ limy-s0 F(X) 
2.1.33 (p. 52) limy+x. f(x) = limyxp g(x) 

2.1.37 (p. 52) (c) limy+x9—(f —8)(x) = Titty x94 FAR se g(x); Litthy s¢4— (= 
g)(x) = lim,_,,,- f(@) - limyx9- (x) 


Section 2.2 pp. 69-73 


2.2.3 (p. 69) (a) from the right (b) continuous (c) none (d) continuous (e) 
none (f) continuous (g) from the left 

2.2.4 (p. 69) [0,1), (0,1), [1,2), (1,2), (1.2), [1.2] 2.2.5 (p. 69) [0,1 ©. 1), 
(1, co) 2.2.13 (p. 70) (b) tanh x is continuous for all x, coth x for all x # 0 
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2.2.16 (p. 70) No 2.2.21 (p. 71) (a) [-1, 1], 0.00) (b) US2_,, nz, (2n+1)z), 


(0, 00) (c) U2 _, (a7, (n + Im), (—0o, -1) U(-1, DU, 00) (d) U2 _ gala, (n+ 
5)], [0, 00) 

2.2.23 (p. 71) (a) (-1,1) (b) (-c0,00) = (c) xo A (2k +37), k =integer (d) 
x #4 (e)x #1 (f)x A (K+ 4x), k =integerr (g)x 4 (kK+4n), k= 
integer (h) x #0 (i)x 40 


Section 2.3. pp. 84-88 


2.3.4 (p. 85) (b) p(c) = g(c) and p“(c) = g4.(c) 

2.3.5 (p. 85) f(x) = n(a—-1)--- @—k—1) x” -*-! |x| if 1 < k <n—1; f(x) =n! 
ifx>0; f(x) = —nlifx <0; f(x) = Oifk > n andx 4 0; f(0) does not 
exist ifk > n. 

2.3.7 (p. 85) (a) c’ = ac —bs, s' = be + as (b) c(x) = e* cosbx, s(x) = 
e?* sin bx 

2.3.15 (p. 86) (b) f(x) = —-lifx <0, f(x) = 1 if x > 0; then f’(0+) = 0, but 
f{.(0) does not exist. (c) continuous from the right 

2.3.22 (p. 87) There is no such function (Theorem 2.3.9). 

2.3.24 (p. 87) Counterexample: Let xo = 0, f(x) = |x|?/? sin(1/x) if x 4 0, and 
f@) =0. 

2.3.27 (p. 88) Counterexample: Let x9 = 0, f(x) = x/|x| ifx 40, f(0) = 0. 


Section 2.4 pp. 96—98 


2.4.2 (p. 96)1 2.4.3 (p. 96)4 244 (p. 96)0o 2.45 (p. 96) (-1)""1n 
2.4.6 (p. 96)1 2.4.7 (p. 96)0 2.48 (p. 96)1 2.4.9 (p. 96) 0 


2.4.10 (p. 96)0 24.11 (p. 96)0 2.4.12 (p. 96)—-co 2.4.13 (p. 96) 0 
2.4.14 (p. 96)-4$ 2415 (p. 96)0 2.4.16 (p. 96) 0 2.4.17 (p. 96) 1 
2.418 (p. 96)1 2.419 (p. 96)1 2.4.20 (p. 96) e 2.4.21 (p. 96) 1 
2.4.24 (p. 96) 1/e 2.4.22 (p. 96) 0 


2.4.23 (p. 96) —co ifa < 0, 0ifa >0 

2.4.25 (p. 96) ec? 2.4.26 (p. 96)1 2427 (p.96)0 2.4.28 (p. 96) 0 
2.4.29 (p. 96) oo ifa > 0, -co ifa <0 

2.4.30 (p. 96) co 2431 (p. 97) 1 2.4.32 (p. 97) 1/1202.4.33 (p. 97) 00 
2.4.34 (p. 97) co 2.4.35 (p. 97) co ifa <0,0ifa >0 

2.4.36 (p. 97) co 2.437 (p. 97) 1 2.4.38 (p. 97)0 2.4.39 (p. 97) 0 
2.4.40 (p. 97)0 2.4.41 (p. 97) (b) Suppose that g’ is continuous at xo and f(x) = 
g(x) ifx < xo, f(x) = 14+ g(x) if x > Xo. 

2.4.44 (p. 97) (a)1 (b)e (c)1 2.4.45 (p. 98) e% 
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Section 2.5 pp. 107-112 


2.5.2 (p. 107) fF (x0)/(n+D!. 2.5.4 (p. 107) (b) Counterexample: Let x9 = 0 
and f(x) = x|x|. 
2.5.5 (p. 108) (b) Let g(x) = 1+ |x —Xxol, so f(x) = (x — x0) (1 + |x — xo). 
2.5.6 (p. 108) (b) Let g(x) = 14+ |x — xo|, so f(x) = (x — x0)? (1 + |x — x0)). 
2.5.10 (p. 109) (b) (i) 1,2,2,0 (ii) 0, -2, 32/2, -40 + 13/2 

(iii) -2?/4,-27,-6+ 27/4,42 (iv) —2,5, -16, 65 
2.5.11 (p. 109) (b) 0,1, 0,5 
2.5.12 (p. 110) (b) (i) 0,1,0,5 (ii) -1, 0,6, -24 (iii) V2, 3V2, 11 V2, 
574/23 (iv) —1, 3, -14, 88 (a) min (b) neither (c) min (d) max (e) 
min (f) neither (g) min (h) min 
2.5.14 (p. 110) f(x) = e1/x? if x £0, f(0) = 0 (Exercise 2.5.1 (p. 107)) 
2.5.15 (p. 111) None if b? — 4c < 0; local min at x1 = (—b + Vb? — 4c)/2 and local 
max at x1 = (—b — Vb? — 4c)/2 if b? — 4c > 0; if b? = 4c then x = —b/2 isa critical 
point, but not a local extreme point. 


25.16 (p. 111) (a) 2(4) 6) FO AE @ ae 

2.5.20 (p. 112) (a) M3h/3, where M3 = supjy_.j<p | f (c)| 
(b) Mh? /12 where Mg = sup)x—cj<n |f (| 

2.5.21 (p. 112) k =—h/2 


Section 3.1 pp. 125-128 


3.1.8 (p. 126) (b) monotonic functions (c) Let [a,b] = [0,1] and P = {0,1}. Let 
f(0) = fd) = > and f(x) = xif0 < x < 1. Then s(P) = Oand S(P) = 1, but neither 
is a Riemann sum of f over P. 


3.1.9 (p. 127) (a) $,-4 (b) 3,1 3.1.10 (p. 127) ce? —e% 3.1.11 (p. 127) 
1—cosb 3.1.12 (p. 1277) sin b 


3.1.14 (p. 127) f@lgi — g(@)] + f(@)(g2 — 81) + FON) - 82] 
3.1.15 (p. 127) f@lgi — s@] + fg) — gpl + Lay f(@m)(Sm41 — Bm) 
3.1.16 (p. 127) (a) If g = 1 and / is arbitrary, then fi f(x) dg(x) = 0. 


Section 3.3. pp. 149-151 
3.3.7 (p. 150) (a)w=c=% (b)¥=c=0 (c)u=(e—-2)/(e-1),c= Vu 
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Section 3.4 pp. 165-171 


3.4.4 (p. 166) 
(a) (i)p>2 (ii) p>0 (iii) 0 
(b) (i)p>2 (ii)p>0 (iii) 0 
(c) (i)none (ii) p>0 (iii) 1/p 


(d) (i)p <0 (ii)0<p<1 (iii) 1/C—- p) 

(e) (i)none (ii) none 
3.4.5 (p. 166) (a)n! (b) 4 (c) divergent (d)1 (e)-1 (f)0 
3.4.8 (p. 166) (a) divergent (b) convergent (c) divergent (d) convergent (e) 
convergent (f) divergent 
3.4.9 (p. 166) (a) p <2 (b)p<1 (c)p>-!1 (d)-1 <p <2(e) none 
(f) none (g) p<1 
3.4.11 (p. 167) (a) p—q <1 (b)p.q<1 (c)-l<p<2q-1(d)q>-l, 
ptq>1 (e)ptq>1 (f)qt+l<p<3q+!1 
3.4.12 (p. 167) deg g—deg f >2 
3.4.18 (p. 168) 


(a) (i) p>1 (ii)0< p<! 
(b) (i) p>1 (ii) p <1 
(c) (i) p>1 (ii) 0<p<l 
(d) (i) p>0 (ii) none 
(e) (i)l<p<4 (ii)0<p<il 
(f) (i)p>3 (ii) O<p<z 


3.4.25 (p. 169) 
(a) (i)p>-1 @i)-2<ps-1 
(b) (i) p>-—1 (ii) none 
(c) (i) p< -I1 (ii) none 
(d) (i) none (ii) none 
O Ope 2 Wis 


Section 4.1 pp. 192-195 


413 (p.192) (a)2 (b)1 (c)O0 414 (p. 192) (a)1/2 (b)1/2 (ce) 
1/2. (d) 1/2 

4.1.11 (p. 192) (d) VA 41.14 (p. 193) (a) 1 (b) 1 (c)1 = (d) -co 
(e) 0 

4.1.22 (p. 193) Ifs, = 1 andt, = —1/n, then (limp—+oo 5n)/(limn—+co tn) = 1/0 = 00, 
but limy—oo Sn/tn = —O0. 

4.1.24 (p. 193) (a) «0,0 (b) 0, -ooif |r| > 1; 2, -2 ifr = -1; 0, 0ifr = 1; 1, 
-lif|r|<1 (c) «,-ocoifr <-1;0,0if |r| < 155, 5ifr = 1,00, ooifr>1 


(d) co, 00 (e) |e], Ie 
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4.1.25 (p. 194) (a)1,-1 (b)2,-2 (c)3,-1 (c) V3/2,-V3/2 


4.1.34 (p. 194) (b) If {sn} = {1,0,1,0,...}, then limpsoo tn = 4 


Section 4.2 pp. 199-200 


4.2.2 (p. 199) (a) limm—+oo Sam = 00, limm—+oo Sam+1 = —00 
(b) limm—oo S4m = 1, limp —+oo S4m42 = —1, limMm—oo S2m41 = 0 
(c) limm— oo S2m = 0, limm—+oo S4m41 = 1, limm—oo S4m43 = —1 


(d) fig 565 84 = 0 (e) lity +co Same = 00, littin oq Samer = 0 
(Ef) lite gsc Sees = tise Senco = 1, liters Sena = 42, 
littn—oo 58m+3 = litin—>co Sam+7 = 0, litn—+co Sam45 = —V2, 
limy—+o0 Sgm+4 = limyy—+oo Sgm+6 = —l 
4.2.3 (p. 199) {1,2,1,2,3,1,2,3,4,1,2,3,4,5,...} 
4.2.8 (p. 200) Let {t,} be any convergent sequence and {s,} = {t1,1,2,2,...,tn,n,...}. 


Section 4.3 pp. 228-234 


4.3.4 (p. 229) (b) No; consider * 1/n 


4.3.8 (p. 229) (a) convergent (b) convergent (c) divergent (d) divergent 
(e) convergent (f) convergent (g) divergent (h) convergent 


43.10 (p. 229) (a)p>1 (b)p>1 (c)p>1 

4.3.15 (p. 230) (a) convergent (b) convergent if 0 <r < 1, divergent ifr > 1 

(c) divergent (d) convergent (e) divergent (f) convergent 

4.3.17 (p. 231) (a) convergent (b) convergent (c) convergent (d) convergent 
4.3.18 (p. 231) (a) divergent (b) convergent if and only if0 <r < 1 orr = 1 and 
p <-—I1(c) convergent (d) convergent (e) convergent 

4.3.19 (p. 231) (a) divergent (b) convergent (c) convergent (d) convergent if 
a < B —1, divergent ifa > B-1 

4.3.20 (p. 231) (a) divergent (b) convergent (c) convergent (d) convergent 


4.3.21 (p. 231) (a) yY(-1)” (b) Yel" /n, y |‘ 1 


+ 
n nlogn 
(c) D(-)"2"_— (d) 1" 
4.3.27 (p. 232) (a) conditionally convergent (b) conditionally convergent (c) abso- 
lutely convergent (qd) absolutely convergent 


4.3.28 (p. 232) Let k and s be the degrees of the numerator and denominator, respec- 
tively. If |r| = 1, the series converges absolutely if and only if s > k +2. The series 
converges conditionally if s = k + 1 andr = —1, and diverges in all other cases, where 
s>k-+land |r| =1. 


4.3.30 (p. 232) (b) N(-1)"/Vn_ 41 (p. 22) (a) 0. (b) 24 — a 
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Section 4.4 pp. 253-256 


4.4.1 (p. 253) (a) F(x) =0, |x| <1 (b) F(x) =0, |x| <1 

(c) F(x) =0, -l1<x<1 = (d) F(x) =sinx, -00 <x < oo 

(e) F(x) =1, -l <x <1; F(x) =0, |x| >1 (f) F(x) =x, -00 <x < 00 

(g) F(x) =x?/2, -oo<x<oo (h) F(x) =0, -w~ <x <0 

(i) F(x) = 1, -00 <x < 00 

4.4.5 (p. 254) (a) F(x) =0 (b) F(x) = 1, |x| < 1; F(x) = 0, |x| > 1 

(c) F(x) = sinx/x 

4.4.6 (p. 254) (c) Fy(x) =x": Se = [-k/(k + DK /(k + D 

4.4.7 (p. 254) (a) [-1, 1] (b) [-r,r] U (13 U {-1}, 0 <r <1 (c) [-r,r]U {1}, 0 < 

r<l 

(d) [-r,r], r>0 (e) (-00,-1/r] U [-r, r] U [1/r, 00) U 1}, O< r <1 

(f) [-rn7],r>0 (g)[-nr],r>0 (bh) (-o,-r] U [r, 00) U {0}, r >0 

(i) [-r,r], r >0 

4.4.12 (p. 254) (b) Let S = (0, 1], Fx(x) = sin(x/n), Gn(x) = 1/x?; then F = 0, 
= 1/x?, and the convergence is uniform, but || FnGn||s = 00. 

4.4.14 (p. 255) (a)3 (b)1 (c)4 (d)e-1 

4.417 (p. 255) (a) compact subsets of (—4,00) (b) [—4, 00) (c) closed sub- 

1-V5 14.5 
2° 2 

of (—oo, 0) U (0, co) 

4.4.19 (p. 255) (a) Let S = (—0v, 00), fn = dn (constant), where }° a, converges 

conditionally, and g, = |d,|. (b) “absolutely” 

4.4.20 (p. 255) (a) (i) means that )* | f,(x)| converges pointwise and > f, (x) con- 

verges uniformly on S, while (ii) means that )* | fy a converges uniformly on S. 


4.4.27 (p. 256) (a) ye 1)” 


sets of (d) (—o0, 00) (e) [7,00), r > 1 (f) compact subsets 


x2ntl 


2n+1 
Ge +1) (b) yen "On +1)(2n +1)! 


n=0 


Section 4.5 pp. 275-280 

4.5.2 (p. 276) (a) 1/3e (b)1 (c)4 (d)1 (e)oo 
4.5.8 (p. 276) (a)1 (b)+ (c)+ (d)4 (e)i/e (f)1 
4.5.10 (p. 277) x(1+x)/(l1—x)? 4.5.12 (p. 277) e*? 
4.5.16 (p. a) _ 


n=1 


(x—1)"; R=1 


4.5.17 (p. 277) Tan— Tye 


n=0 


; F290) = 0; f2*Y (0) = 1 Qa)! 


(2n + 1)’ 


Answers to Selected Exercises 555 


1 1 = (1)? 

- = Tan7!— = ee Si 

6 an VB dX (Qn + 1)3"+1/2 
iced Oo yp 2ntl 


2n 
4.5.22 (p. 278) coshx = by oat sinh x = Pos Qn+D! 


n=0 n=0 
4.5.23 (p. 278) (1 —x) )°p2.9 x” = 1 converges for all x 


3 3 5 2. 5 3 
45.4 (p. 278) (a) x+x?+—-[ 4... (b) 1-x-F + +--- (0) 
x2 x4 = -721x x3 x4 x8 
re i eae eae ee 
2°24 720 ea at 


x2 3x3 5x4 


2x2 x3 x? 
4.5.27 (p. 279) (a)l+x+——+—+4+::: (b)1-x-~—+—+4+-:-(c) 14+ —4+—+ 


(aia 3 oa - ate aa - 
— es eee —XxX —_—_ — eee 
6 360 15120 12 360 


ee — on + 2 _ yp _ (oy 
(—3x)1+2x) 1-3x 1+4+2x ra 


2 24 


4.5.28 (p. 279) F(x) = 


4.5.29 (p. 279) 1 


Section 5.1 pp. 299-302 
5.1.1 (p. 299) (a) (3,0,3,3) (b) (-1,-1.4) (c) ¢.4.3.3 


6? 12? 24° 36 
5.1.3 (p. 299) (a) VIS) (b) V65/12. (ce) V31_ (d) V3 
5.1.4 (p. 299) (a) V89  (b) V166/12. (c)3  (d) V3 
5.1.5 (p. 299) (a) 12. (b) 4 (ce) 27 
5.1.7 (p. 299) X = Xo +1U (—oo <t < oc) in all cases. 
5.1.8 (p. 299) ...U and X; — Xo are scalar multiples of V. 
5.1.9 (p. 299) (a) X = (1, -3, 4,2) +4(1, 3, 5, 3) 
(b) X = (, 1,2, 1,4,) + #(-1,-1, 1,3,-7) 
(c) X= (1,2,=1) 471, 3,0) 
5.1.10 (p. 300) (a)5 (b)2 = (c) 1/25 
5.1.11 (p. 300) (a) (i) {(x1, x2, x3, x4) | |xi| < 3 (i = 1,2, 3) with at least one equality} 
(ii) {(01, x2,.x3, x4) | |xil <3 @ = 1,2,3)} (iii) S 
(iv) {(x1, x2, x3, X4) | |x;| > 3 for at least one of i = 1,2,3} 
(b) (i) S (ii) S (iii) ® (iv) {@, 9,2) |z Florx? + y? > 
5.1.12 (p. 300) (a) open (b) neither (c) closed 
5.1.18 (p. 300) (a) (2.1.0) (b) (1,0,e) 
5.1.19 (p. 300) (a)6 (b)6 (c)2V5 (d)2LVn_ (e) co 
5.1.29 (p. 302) {(x, y)|x? + y? =1} 


61x°® 
720 


+ 
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5.1.33 (p. 302) ... if for A there is an integer R such that |X,| > Aifr > R. 


Section 5.2 pp. 314-316 


5.2.1 (p. 314) (a) 10 (b)3 (c)1 (d)O (e)O (f)0 

5.2.3 (p. 315) (b) a/(1 +a?) 

5.2.4 (p. 315) (a)oo (b)oo (c)no (d)-—co (e)no 

5.2.5 (p. 315) (a)0 (b)0 (c)none (d)0 (e) none 

5.2.6 (p. 316) (a) ...if Dy is unbounded and for each M there is an R such that 
f(X) > M ifX € Dy and |X| > R. (b) Replace “> M” by “< M” in (a). 

5.2.7 (p. 316) limy.9 f(X) = Oifa;+a2+-+-+a, > b; no limitifay+a2+-+-+an < 
b and aj +45 4+---+a? 40; limy49 f(X) = 00 if ay = az = +++ = ay = Oandh > 0. 
5.2.8 (p. 316) No; for example, limy—o g(x, /x) = 0. 

5.2.9 (p. 316) (a) R? (b) R? (c)R® (d)R? (e) {@,y)|x>=y} (f) R" 
5.2.10 (p. 316) (a) R* — {(0,0,0)}| (b)R? (c)R? (d)R* (e)R 

5.2.11 (p. 316) f(x, y) = xy/(x? + y*) if (x, y) 4 (0,0) and f(0,0) = 0 


Section 5.3 pp. 335-339 


5.3.1 (p. 335) (a) ea + ycos x — xy sinx) — 2/206 cos x) (b) estas 


(c) als +82 bob) (d) 1/d+x+y+2z) 


5.3.2 (p. 335) 626) 3 (p. 2?) (a) -5x/V6 (b)—2e (c)0 (d)0 

5.3.5 (p. 335) (a) fh. = fy = 1/xt+y +22), fe = 2/(x + y + 22) 

(b) fe = 2x + 3yz + 2y, fy = 3xz + 2x, fp = 3xy (c) fe = 0%, fy = xze, 
fn = V0 * (d) fe = Iv cos, fp = FOS re = 1 

5.3.6 (p. 335) (a) fx = fy = fey = fox = —V/(x + y +22), fez = fox = 
foe = fey = 2K + y £227, fee = ~4/ (+ y +22)? 

(b) Sex = 2, fyy = fez =9, fay = fox = 3242, faz = fex = 39, fyz = fey = 3x 
(c) hex = 9, fyy = xe, tez = xy7e%, Sey = fyx = 70%, fez = fox = ye, 
hyz = Izy = xer*% 

(d) jn = 2yeess y= 4 sins og = a a ee HO = Ty = 
2x cos x? y — 2x3y sinx*y, Fz = Tex = Syz = Tey = 0 

5.3.7 (p. 336) (a) fcx(0,0) = fyy (0,0) = 0, fry (0,0) = -1, fyx (0,0) = 1 

(b) Fx (0, 0) = vy, 0) = 0, Sey (0, 0) = —l, Syx (0, 0) = 1 

5.3.8 (p. 336) f(x, y) = g(x, y)+A(y), where gxy exists everywhere and h is nowhere 
differentiable. 
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5.3.18 (p. 337) (a) df = (3x? +4y?4+2y sinx +2xy cos x) dx + (8xy +2x sin x) dy, 
dx, f = 16 dx, (dx, f)(X — Xo) = 16x 

(b) df = -e*-¥~ (dx + dy + dz), dx, f = —dx — dy — dz, 

(dx f)(K — Xo) =-x-y-z 

(c) df = (1+ x, + 2x2 +---4+ nxn)! Ss J dxj, dxy f = Dal J dx ;, 
(dxy f )(X — Xo) = Vian xj, 

(d) df =2r|X/?* 1 87 dX}, dey f =2rn"™ ai at 

(dxo f )(X — Xo) = 2rn™! D1 (xj — 1), 

5.3.19 (p. 337) (b) The unit vector in the direction of (fy, (Xo), fx. (Xo), ---, San (Xo)) 
provided that this is not 0; if it is 0, then 0f(Xo)/0® = 0 for every ®. 


5.3.24 (p. 338) (a) z =2x+4y-6 (b)z = 2x4+3y4+1(c) z = (ax)/2+y—n/2 
(d)z=x+10y+4 


Section 5.4 pp. 356-360 


5.42 (p. 357) (a)5du+34dv (b)0 (c)6du—18dv (d) 8du 

5.4.3 (p. 357) h, = f,cos6 + fy sind, hg =r(—fy sind + fy cos 0), hz = fz 

5.4.4 (p. 357) h, = f, sing cos 6+ fy sing sind + f, cos ¢, hg =r sind(—f sind + 

fy cos 6), hg =r(fx cos dcosé + fy cos¢siné — f, sing) 

5.4.6 (p. 357) hy = &xXy + Sy + SwWy, hz = BxxXz + Bz + SwWz 

5.4.13 (p. 358) hy, = frx sin? ¢ cos? 6+ fyy sin? sin? 6+ fz cos? + fry sin?  sin20+ 
yz sin2¢ sin 6 + fxz sin2¢ cos 0, 

hye = (—fx sin®@ + fy cos @) sing + shy — fex) sin? o sin20 + rfxy sin? @ cos 20 + 


5 (fey cos 6 —_ tex sin 0) sin 2 


x2 y? 
5.4.16 (p. 358) (a) ae pee es a 


x2 
(b) Pe eee eg 
(c)0 (d) xyz 
5.4.21 (p. 359) (a) (dG 9) PI. Y) = doo) Dy) = 2x - y)? 


Section 6.1 pp. 376-378 


3 4 6 : = 
6.1.3 (p. 376) (a)| 2 -4 2} (b)} > 4 
at 2:3 4 


8 8 16 24 —2 «6 wo 
6.1.4 (p. 376) | 0 0 4 2 «| 0.2 “| 


12 16 28 44 —2 2 -6 
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2 2 6 =1 7 
6.1.5 (p. 376) (a) . 73 | (b) 3. «5 | 
0 6 5 14 


13. 25 
6.1.6 (p. 376) (a) | 16 31 b) | 7? 
(p yi | 1 | o)| 50 | 


25 
6.1.10 (p. 377) A and B are square of the same order. 


7 3.3 14 10 
6.1.12 (p. 377) (a) 4) 9 4 | (b) 6 2 | 
6 1 


= 14 2 
76 4 5 60 
6.1.13 (p. 377) | -9 7 13 |, 4 -12 3 
5 0 —14 4 0 3 


6.1.15 (p. 377) (a) [| 6xyz 3xz? 3x?y |;[ -6 3 -3 | 

(b) cos(x+y)[ 1 1];[ 0 0] 

(c) [ (l—xz)ye**  xe*% x? ye** ];[ 2 1 -2 | 

(d) sec2(x+2y+z)[ 1 2 1 ];[2 4 2 ] 

(e) [X[-1[ x1 x2 +) xn Js fl 1s 1] 

6.1.20 (p. 377) (a) (2,3,-2)  (b) (2.3.0) (ce) (-2,0,-1)  (d) G.1,3.2) 
6.1.21 (p. 378) (a) Z| 2 (b) + 4 

1.21 (p. ee 4 5 


—-1 2 


3 

=| 

5 ipoiai 
a) (dye) eft 4 4 
10 2) 4041-1 


3 
8 
4 
0 O -l1 -2 0 5 
0 O 1] -14 -18 10 20 
2 -3 (55 21 22 -10 —25 
1 2 17 24 -10 —25 


Section 6.2 pp. 390-394 


2x 1 2 
6.2.12 (p. 392) (a) F(X) =| ~sin@ +y +z) —sine +y +z) —sin@ + y +z) 
yzeryz xzerxve xyervz 


JF(X) = e** sin(x + y + z)[x(1 — 2x)(y —z) —z(x — y)]; 
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cosy —e*siny 
siny  e*cosy 


| 
| 

cx =[T]+[ 4 cleo 
| 


—2 0 x—1 
2 —2 y-l 
0) 2 z-1 


(x+y+z+le*  e* ‘al 


6.2.13 (p. 392) (a) F(X) = (2x —x2—y?)e* 2ye* 0 


81 (x) 
/ 
(b) Fay =| 220 
8n(X) 
e*~sinyz ze*cosyz ye*cosyz 
(c) F(r,0) =| ze%cosxz e%sinxz xe’ cos xz 
ye*cosxy xe*cosxy e*sinxy 
cos@ —rsind 
sinO rcosd 


6.2.14 (p. 392) (a) F(r, 0) = |: JF 6) =F 


cos@cos@ -—rsinOcos@ —rcosésing 
(b) F’(r,6,¢) =| sinOcosp rcosAcosd —rsinOsing |; 


sind 0 rcos@ 
JF(r, 0,0) =r? cosd 


cos@ -—rsin@d O 
(c) F(r,6,z) = | sin rcos6 0 |; JF(r,6,z) =r 
0 0 1 


6.2.20 (p. 393) (a) | 6 2 | | 5 > | 


@lo 7 |, Ol «| o| | 
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Section 6.3 pp. 414-417 


6.3.4 (p. 414) (a) [1,7/2] (b) [1,22] (c) [1,2] (d) [2V2,92/4]  (e) 
[V2, 32/4] 

6.3.5 (p. 414) (a) [1,-32/2] (b) [1,-22] (c) [1,-x] (d) [2V2,-72/4] 
(e) [V2, 52/4] 

6.3.6 (p. 414) (b) Let f(x) = x (0 < x < 4), f(x) =x—4(§ <x < 1); then f is 
locally invertible but not invertible on [0, 1]. 

6.3.7 (p. 414) F(S) = {(u, v) | —1+2¢ < arg(u,v)<a+ 29}, where ¢ is an argu- 
ment of (a, b); 

cos(arg(u, v)/2) 


sin(arg(u, v)/2) 
1 - 1 = 
6.3.10 (p. 415) (a) : |- a| a I ers rl >] 


x 1 u+2v+3w 1 1 2 3 
(b)| y | == u—w > (Fy =-] 10 -1 
Zz 2 utvu+2w 2 1 1 2 


6.3.12 (p. 415) Gi (u,v) = =| Ga 610.0) = I == | 


Fs) = 2 4 "4 |: 26 arti) «26-4 


é _ 17 -vetu @ — Lf -1/futu -1l/J/ut+u 
el. fone POOH Fe) 1am. litem 


e ol Ju+to Gi ol 1/J/uto 1/J/uto 
SU meme POS = Se) aiieen: 1. /a=e 


Ga(u v= | Gi (u v=>5| —l/ Ju to eee 

. | eer Poe fF | =1/ afk =O 1/.j/u—v 
6.3.15 (p. 416) From solving x = rcos 0, y =r sin for @ = arg(x, y). Each equation 
is satisfied by angles that are not arguments of (x, y), since none of the formulas identifies 
the quadrant of (x, y) uniquely. Moreover, (c) does not hold if x = 0. 


cos[4 arg(u, v)| 
sin(arg(u, v)/2) i 
where 6 — 2/2 < arg(u,v) < B + 2/2 and Bf is an argument of (a, b); 


6.9) = | * a 


6.3.16 (p. 416) = G(u,v) =? + nel 


207 Y") oY oe 
6.3.19 (p. 416) If F(x1, x2,...,Xn) = (x7, x3,..., x3), then F is invertible, but 
JF(0) =0. 


6.3.20 (p. 416) (a) aw =| _j l-s/3 Alea 
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eoae-[]o4[ $3] 
aw] 1] i 
1 0 


1 0 -l u 
(d) AU) =] 27/2 |+] 1 O O v+1 
1 0 oO -1 w 


cos 6 cos @ sin cos @ sing 
sind cos 6 
6.3.21 (p. 417) G(x, y,z) =  rcosd rcos@ . 
—-cos@sing —-sinOsing —cos¢ 
r r r 
cos 6 sind 0 
6.3.22 (p. 417) G(x, y,z) = ae sind de 6 0 
r r 
0 0 1 


Section 6.4 pp. 431-434 


641 (p. 431) (a) | ¥ ]=5] 4 Paiia 


w]e fa} |[sJo[s]-i[4 3][2as 


(d) vu =-x,v=-y,z = —w 


6.4.3 (p. 431) f,(X,U) = (3: Gi (Xj -»9) — (uj —ujo)*, 1 <i < m, wherer 
j=1 

and s are positive integers and ae Hac =O. (a)r]—s=— 3 (b) rH Le] 3; (6) 

r=s=2 

6.4.4 (p. 431) ux(1, 1) = —2, uy(1, 2) = —4 

6.4.5 (p. 431) ux (1,1, ) = 3, uy(1, 1, 2) = -2, uz(1, 1,1) = $ 

6.4.6 (p. 431) (a) u(1,2) = 0, ux(1,2) = uy(1,2) = —4 

(b) u(—1, —2) = 2, ux(—1, —2) = 1, uy(-1, -2) = —4 

(c) u(a/2, 2/2) = ux (2/2, 2/2) = uy(2/2, 2/2) =0 

(dx. 1) =1.4,1,1)$%,0,)<—1 

dui(1, 1) dui(1, 1) 
ax : ~ 


: 2 
dy 


6.4.7 (p. 431) (a) wi(1, 1) = 1, 


562 Answers to Selected Exercises 


du2(1, 1) =} : du2(1, 1) =: 


ua(1, 1) = 2, ie 2 
(b) ux (0, 7) = (2k + 1)7/2, Ou 2) = 0, dux(0, 7) =-—l, k =integer 
Ox dy 
1/ -1 —2 1 ’ ’ 
648 (p. 432) =] ~) _y , | 649 (p. 432) w'(0) =3, 00) =-1 


ie 
6.4.10 (p. 432) =| —5 —5 
Cl) ie. 2% 


6.4.11 (p. 432) Ui(1, 1) = : pean - Zi 3 |: 


wa.) =—| ; | ean =-[ 3 7 | 


6.4.12 (p. 432) ux (0, 0,0) = 2, vx(0, 0,0) = wx(0, 0,0) = —2 


d(f, g,h) d(f, g,h) d(f, g,h) 
O(x, Z, u) O(v, Z, u) O(y, x,u) 
SAID B08) Ye arg hy ae Og 
d(y, Z,u) d(y, Z,u) d(y, Z,u) 
a(f, g,h) a(f, g,h) a(f, g,h) 
ze, = 20.4) 902%) 1 YZ, 9) 
7 d(f,g,h)> * d(f,g,h)> ” d(f, g,h) 
d(y, Z,u) d(y, Z,u) d(y, Z,u) 
6.4.14 (p. 433) x = -2y —u,z = -2u;x = -2y-—u,v = a y= ea om 
a ie D 2 2 
SS Se oS ee ee 


6.4.15 (p. 433) yx(1,-1,-2) = —4, vu(1,-1,-2) = 1 


6.4.16 (p. 433) uy (0,-1) = 2, uy(0,-1) = 0, vw (0, -1) = —2, vy(0,-1) = 0, 
Xw(0,-1) = 1, x»(0,-1) = -1 


6.4.18 (p. 434) u.(1, 1) = 0, uy, 1) = 0, 0x1, 1) = -1, vy, DP) = -1, ux, 2) = 
ett. 1) = 1, vyyC, 1) = 2, vex (1, 1) = —2, vey, 1) = 1, vyyC, 1) = -2 

6.4.19 (p. 434) ux(1,-1) = 0, uy(1,-l) = > vx(1,-1) = -5 vy(1,-1) = 0, 
Uxx(1,—-1) = - uxy(1,—1) = z Uyy(,—-1) = E Vxx(1,-1) = > 


8 
1 
Uxy(1, —1) = ~ 9? vyy(1, —l) = 


co | oo 


Index 563 


Section 7.1 pp. 459-462 
7.1.2 (p. 459) (a) 28 (b) + 6 (p. 2?) 3-—a)(d —c),0 13 (p. 22) 


{(m, n) | mn = integers} 


Section 7.2 pp. 480-484 


7.2.1 (p. 480) (a) 12 (b) 2 (c)-1 (d) (1—1log2)/2 
7.2.5 (p. 481) (a)Z (b) 17) (ce) 2(V2-1) (d) 1/42 

7.2.7 (p. 481) (a) 3,2 (b) 2,2 7.2.8 (p. 482) (a) 3,5 (b) 3(z +3), 
qe4o) (c)ergl 

7.2.11 (p. 482) (a) -285 (b)0 (c)0 (d) ¢(e-3) 

7.2.12 (p. 483) (a) 324. (b) 2 (c)1 7.2.13 (p. 483) 2 
7.2.14 (p. 483) (a) 36 (b)1 (c)S (d) @% + 17)/2 
7.2.17 (p. 483) (a) 4 (b) $(e-32) (DE (ADH 

7.2.18 (p. 483) (a) 16x (b)+ (c) 28 (d)z% 

7.2.19 (p. 484) (a) $(b1 —41)++- (bn — an) D1 (Gj + 5;) 

(b) $1 — a1) +++ (On — an) = (G3 +.4jb; + 5?) 

(c) 2-"(b} — aj) +++ (GF — a7) 

7.2.20 (p. 484) [YU ax fea fo, y)dy 7.2.22 (p. 484) 4 


Section 7.3 pp. 514-517 


7.3.1 (p. 514) Let S; and Sz be dense subsets of R such that S$; U Sz = R. 

7.3.7 (p. 514) (a) —1;c (constant);1 9 (p. 2?) (v2 —u1)(v2 — v1)/\ad — bc| 
7.3.10 (p. 515) 2 7.3.14 (p. 515) (a) $ (b) log3 7.3.15 (p. 516) 3 
7.3.16 (p. 516) 4 7.3.17 (p. 516) 3e(e — 1) 

7.3.18 (p. 516) $zabe 7.3.19 (p. 516) 2x(e?> —e°) 7.3.20 (p. 516) 1677/3 
7.3.21 (p. 516) 21/64 

7.3.22 (p. 516) (a) (2/8)log5 (b) (7/4)(e*- 1) (c) 27/15 

7.3.23 (p. 517) 27a*/2 

7.3.24 (p. 517) (a) (B81 —@1)-++(Bn —On)/|det(A)| 25 (p. 2?) |araz-++dn|Vn 


Index 


A 
Abel’s test, 219 
Abel’s theorem, 273, 279 
Absolute convergence, 215 
of an improper integral, 160 
of a series of constants, 215 
of a series of functions, 247 
Absolute integrability, 160 
Absolute uniform convergence, 247, 255 
(Exercises 4.4.17 and 4.4.20), 
256 (Exercise 4.4.21) 
of a power series, 257 
Absolute value, 2 
Addition of power series, 267 
Adjoint matrix, 370 
Affine transformation, 380 
Alternating series, 203 
test, 203, 219 
Analytic transformation, 416 (Exercise 6.3.17) 
Angle between two vectors, 286 
Antiderivative, 143, 150 (Exercise 3.3.16) 
Archimedean property, 5 
Area under a curve, 116 
Argument, 398 
branch of, 409, 410, 415 (Exercise 6.3.14) 
Ascoli—Arzela theorem, 541 
Associative laws 
for the real numbers, 2 (see p. 1) 
for vector addition, 283 


B 
Bessel function, 277 (Exercise 4.5.11) 
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Binomial coefficient, 17 (Exercise 1.2.19), 
102, 194 (Exercise 4.1.35) 
Binomial series, 266 
Binomial theorem, 17 (Exercise 1.2.19) 
Bolzano—Weierstrass theorem, 27, 294, 
301 (Exercise 5.1.22) 
Bound 
lower, 7 
upper, 3 
Boundary, 526 
point, 289, 526 
of a set, 23, 289 
Bounded convergence theorem, 243 
Bounded function, 47, 60, 313 
Boundedness of a continuous function 
on aclosed interval, 62, 199 
on a compact set, 313 
Boundedness of an integrable function, 
119 
on a metric space, 536 
Bounded sequence, 181, 197, 292 
Bounded set 
above, 3, 313 
below 7, 313 
Bounded variation, 134—135 (Exercises 3.2.7, 
329,492.10) 
Branch 
of an argument, 409, 415 
of an inverse, 409 


C 
C[a,b], 521 
equicontinuous subset of, 539 


uniformly bounded subset of, 539 
Cartesian product, 31, 435 
Cauchy product of series, 226, 233 (Ex- 
ercise 4.3.40), 280 (Exercise 4.5.32) 
Cauchy sequence, 527 
Cauchy’s convergence criterion 
for sequences of real numbers, 190 
for sequences of vectors, 292 
for series of real numbers, 204 
Cauchy’s root test, 215 
Cauchy’s uniform convergence criterion 
for sequences, 239 
for series, 246 
Chain rule, 77, 340, 388 
Change of variable, 145, 147 
in an improper integral, 164 
in a multiple integral, 496 
formulation of the rule for, 494 
in an ordinary integral, 145, 147 
Changing the order of integration, 478 
Characteristic function, 70 (Exercise 2.2.9), 
485 
Closed 
under scalar multiplication, 519 
under vector addition, 519 
Closed interval, 23 
Closed n-ball, 291 
Closed set, 21, 289, 525 
Closure of a set, 23, 289 
Cofactor, 370 
expanding a determinant in, 371-372 
Commutative laws 
for the reals, 2 (See p. 1) 
for vector addition, 283 
Compact set, 20, 293, 536 
Comparison test 
for improper integrals, 156 
for series, 206 
Complement of a set, 20 
Complete metric space, 527 
Completeness axiom, 4 
Complete ordered field, 4 
Component function, 311 
Components, 284 (see p. 281) 
of a vector-valued function, 311, 362 


Index 565 


Composite function, 58, 311 
continuity of, 59, 311 
differentiability of, 77, 340 
higher derivatives of, 345 
Taylor polynomial of, 109-110 
(Exercise 2.5.11) 
Composition of functions, 58 
Conditional convergence 
of an improper integral, 162 
of a series, 217 
Conditionally integrable, 162 
Connected metric space, 547 (Exercise 8.3.2) 
Connected set, 295 
polygonally, 296 
Containment of a set, 19 
Content, 453 
of a coordinate rectangle, 437 
of aset, 485 
zero, 448, 514 (Exercise refexer:7.3.2) 
Continuity, 54, 302 
of a composite function, 59, 311 
of a differentiable function, 76, 325 
of a function of 1 variables, 309 
of a function of one variable, 54 
on an interval, 55 
from the left, 54 
of a monotonic function, 67 
piecewise, 56 
from the right, 54 
on aset, 56, 311 
of a sum, difference, product, and 
quotient, 57, 311 
in terms of sequences, 198 
of a transformation, 379 
uniform, 64, 66, 314, 392 (Exercise 6.2.10) 
of a uniform limit, 242 
of a uniformly convergent series, 250 
Continuous function 54, 309 
boundedness of, 62, 313 
extreme values of on a closed inter- 
val, 62 
integrability of, 133 
intermediate values of, 63, 313 
on a metric space, 543 
Continuous transformation, 379 
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Continuously differentiable, 73, 80, 329, 
385, 409 
Contraction mapping theorem, 545 
Convergence 
absolute 
of an improper integral, 160 
of a series of constants, 215 
absolute uniform, 247 
conditional 
of a series, 217 
of an improper integral, 162 
of an improper integral, 152 
of an infinite series, 201 
interval of, 258 
pointwise 
of a sequence of functions, 234, 
238 
of a series of functions, 244 
of a power series, 257 
radius of, 258 
of a sequence in a metric space, 526 
of a sequence in R”, 292 
of a sequence of real numbers, 179 
of a series of constants, 200 
of a sum, difference, or product of 
sequences, 184 
of a Taylor series, 264 
uniform, 246 
of a sequence, 237 
of a series, 246 
Coordinate cube, 437 
degenerate, 437 
nondegenerate, 437 
Coordinate rectangle, 437 
Coordinates, 
polar, 397, 502, 505 
spherical, 507 
Covering, open, 25, 293, 535 
Cramer’s rule, 373 
Critical point, 81, 335 
Curve, differentiable, 453 


D 
Decreasing sequence, 182 
Dedekind cut, 9 (Exercise 1.1.8) 


Dedekind’s theorem, 9 (Exercise 1.1.8) 
Defined inductively, 12 
Degree 
of a homogeneous polynomial, 352 
of a polynomial, 98 
Deleted €-neighborhood, 22 
Deleted neighborhood, 525 
Dense set, 6, 29 (Exercise 1.3.22), 70 (Ex- 
ercise 2.2.10) 
Density of the rationals, 6, 392 (Esercise 6.2.11) 
Density of the irrationals, 6 
Denumerable set, 176 
Derivative, 73 
of a composite function, 77 
directional, 317 
infinite, 88 (Exercise 2.3.26) 
of an inverse function, 86 (Exercise 2.3.14) 
left-hand, 79 
nth, 73 
one-sided, 79 
ordinary, 317 
partial, 317 
of a power series, 261-262 
right-hand, 79 
rth order, 319 
second, 73 
of a sum, difference, product, and 
quotient, 77 
zeroth, 73 
Determinant, 368 (see p. 369) 
expanding in cofactors, 371-372 
of a product of square matrices, 370 
Diameter of a set, 292, 586 
Difference quotient, 73 
Differentiability 
of a composite function, 340 
continuous, 329 
of a function of one variable, 73 
of a function of several variables, 323 
of the limit of a sequence, 243 
of a power series, 260-262 
of a series, 252 
Differentiable 73, 323 
continuously, 73, 80, 409 
curve, 453 


function, continuity of, 76, 325, 385 
on an interval, 80 
on a set, 73 
surface, 453 
transformation, 380 
vector-valued function, 339 
Differential, 326 
higher, 348 
of a linear transformation, 367 
matrix, 367, 381 
of a real-valued function, 326 
of a sum, difference, product, and 
quotient, 328 
of a transformation, 381 
Differential equation, 170-171 
(Exercises 3.4.27—3.4.29) 
Directional derivative, 317 
Dirichlet’s test 
for improper integrals, 163 
for series of constants, 217 
for uniform convergence of series, 
248 
Disconnected set, 295 
Discontinuity 
jump, 56 
removable, 58 
Discrete metric, 519 
Disjoint sets, 20 
Distance 
in a metric space, 518 
from a point to a set, 301 
(Exercise 5.1.24) 
between subsets of a metric space, 
547 (Exercise 8.3.3) 
between two sets, 301 
(Exercise 5.1.25) 
between two vectors, 283 
Distributive law, 2 (see p. 1) 
Divergence, unconditional, 233 
(Exercise 4.3.38) 
Divergent improper integral, 152 
Divergent sequence, 179 
Divergent series, 201 
Domain of a function, 31 (see p. 30), 543 
Double integral, 438 
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E 

Edge lengths of a coordinate rectangle, 
437 

Elementary matrix, 488 

Empty set, 4 

Entries of a matrix, 364 

€-neighborhood, 21, 289, 525 

e-net, 538 

Equicontinuous subset of C[a, b], 539 

Equivalent metrics, 529 

Error in approximating derivatives, 112 
(Exercises | 12—112) 

Euclidean n-space, 282 (see p. 281) 

Euler’s constant, 230 (Exercise 4.3.14) 

Euler’s theorem, 357—358 (Exercise 2.4.8) 

Existence of an improper integral, 152 

Existence theorem, 420 

Expanding a determinant, 362-372 

Exponential function, 70 (Exercise 2.2.12), 
72 (Exercise 2.2.33), 228, 273 

Extended mean value theorem, 106 

Extended reals, 7, 

Exterior point, 289, 526 

Exterior of a set, 23, 289, 526 


F 
Faa di Bruno’s formula, 109 
(Exercise 2.5.11) 
Fibonnacci numbers, 17 (Exercise 1.2.17) 
Field 
complete ordered, 4 
ordered, 2 
properties, 2 (see p. 1) 
Finite real, 7 
First mean value theorem for integrals, 
139 
Forward differences, 104,71 (Example 2.2.18), 
112 (Exercises 2.5.19-2.5.22) 
Fredholm’s integral equation, 546 
Function 31, 32 
absolutely integrable, 160 
Bessel, 277 (Exercise 277) 
bounded, 47, 60, 313 
above, 60, 313 
below, 60, 313 
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of bounded variation, 134 (Exercise 3.2.7) 
characteristic, 70 (Exercise 2.2.9), 485 
composite, 58, 311 
decreasing, 44 
differentiable at a point, 73, 323 
domain of, 31, 32 
exponential, 70 (Exercise 2.2.12), 72 
(Exercise 2.2.33), 227, 273 
generating, 278 (Exercise 4.5.26) 
homogeneous, 357 (Exercise 5.4.8) 
increasing, 44 
infimum of, 55, 313 
inverse of, 68 
linear, 325 
locally integrable, 152 
maximum of, 60 
monotonic, 44, 67 
nondecreasing, 44 
nonincreasing, 44 
nonoscillatory at a point, 162 
nth power of, 33 
oscillation of, 171 
piecewise continuous, 56 
range of, 31, 32 
rational, 33, 232, (Exercise 4.3.28), 
276 (Exercise 4.5.4) 

real-valued, 302 
restriction of, 399 
Riemann integrable, 114, 438 
Riemann-Stieltjes integrable, 125 
strictly monotonic, 44 
supremum of, 313 
value of, 31, 32 
vector-valued, 311 

Functions, 
composition of, 58, 311 
difference of, 32 
product of, 32 
quotient of, 32 
sum of, 32 

Fundamental theorem of calculus, 143 


G 


Generalized mean value theorem, 83 


Generating function, 278 (Exercise 4.5.26) 
Geometric series, 202 
Grouping terms of series, 220 


H 

Heine—Borel property, 

Heine—Borel theorem, 172, 66, 172, 293 

Higher derivatives of a composite func- 
tion, 345 

Higher differential, 348 

Homogeneous function, 357 (Exercise 5.4.8), 
359 (Exercise 5.4.23) 

Homogeneous polynomial, 359 (Exercise 5.4.22), 

Homogeneous system, 375 

Hypercube, 295 (see p. 294) 

Holder’s inequality, 521 


I 
Identity matrix, 370 
Image, 394 
Implicit function theorem, 420, 423 
Improper integrability, 146 
Improper integral, 152 
absolutely convergent, 160 
change of variable in, 164 
conditionally convergent, 162 
convergence of, 152 
divergence of, 152 
existence of, 152 
of a nonnegative function, 156 
Incompleteness of the rationals, 6 
Increasing sequence, 182 
Indeterminate forms, 91, 93-95 
Induction assumption, 12 
Induction proof, 12 
Inequality, 
Holder, 521 
Minkowski, 522 
Schwarz, 284 
triangle, 2, 285 
Infimum 
of a function, 60, 313 
of a set, 7 
existence and uniqueness of, 7, 9 
(Exercise 1.1.6) 


Infinite derivative, 88 (Exercise 2.3.26) 


Infinite limits, 42, 306, 317, 316(Exercise 5.2.6) 


Infinite sequence, 179 
in a metric space, 526 
Infinite series, 210, 244 
convergence of, 201 
integrability of, 251 
oscillatory, 201 
Infinity norm, 496, 523, 524 
Inner product, 284 
Instantaneous 
rate of change, 74 
velocity, 74 
Integrability 
conditional, 162 
of a continuous function, 133 
of a function of bounded variation, 
134 (Exercise 3.2.7) 
improper, 152 
of an infinite series, 251 
local, 152 
of a monotonic function, 133 
of a power series, 264 
Integrable 
Riemann, 114, 438 
Riemann-Stieltjes, 125 
Integral 
over an arbitrary set in R”, 452 
of a constant times a function, 136, 
456 
double, 439 
improper, 151 
iterated, 462 
lower 
for Riemann integral, 120, 442 
for Riemann-Stieltjes integral 128 
(Exercise 3.1.17) 
multiple, 439 
ordinary, 439 
of a product, 138, 456 
proper, 153 
over a rectangle in R”, 436 (See p. 435) 
Riemann, 114, 438 
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Riemann-Stieltjes, 125, 127 (Exer- 
cise 3.1.16), 135 (Exercises 3.2.8— 
3.2.10), 151 (Exercise 3.3.23) 
over subsets of R”, 436 (See p. 435), 
450, 452, 471-472 
of asum, 136, 456 
test, 207 
triple, 439 
Integration by parts, 144 
for Riemann-Stieltjes integrals, 135 
(Exercise 3.2.8) 
Interior of a set, 21, 289 
Interior point, 21, 289, 525 
Intermediate value theorem 
for continuous functions, 63, 313 
for derivatives 82 
Intersection of sets, 20 
Interval 
closed, 23 
half closed, 23 
half open, 23 
open, 21 
semi-infinite, 21, 23 
Interval of convergence, 258 
for derivatives, 82 
Inverse function, 68 
branch of, 409 
derivative of, 86 (Exercise. 2.3.14) 
of a function restricted to a set, 399 
of a matrix, 370 
of a transformation, 396 
Inverse function theorem, 412 
Invertible, locally, 400 
Invertible transformation, 396 
Irrational number, 6 
Isolated point, 23, 289, 526 
Iterated integral, 462 
Iterated logarithm, 97 (Example 2.4.42), 
167 (Exercise 3.4.10), 208 230 


(Exercise 4.3.11), 230 (Exercise 4.3.16) 


J 
Jacobian, 384, 426 
Jordan content, 485 
changed by linear transformation, 488 
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Jordan measurable set, 485, 488 
Jump discontinuity, 56 


L 
Lebesgue measure zero, 175, 177 (Exer- 
cises 3.5.7, 3.5.8) 
Lebesgue’s existence criterion, 176 
Left limit inferior, 47 
Left limit superior, 47 
Left-hand derivative, 79 
Left-hand limit, 38 
Legendre polynomial, 278 (Exercise 4.5.27) 
Leibniz’s rule, 86, (Exercise. 2.3.12) 
Length of a vector, 283 
l’Hospital’s rule, 88 
Limit of a real-valued function, 302 
Limit 
along a curve, 315 (Exercise 5.2.3) 
in the extended reals, 43 
inferior of a sequence, 188 
left, 47 
infinite, 42, 306, 316 (Exercise 5.2.6) 
at infinity, 307, 316 (Exercise 5.2.6) 
left-hand, 38 
one-sided, 37, 40 
point, 23, 289, 526 
pointwise, 234, 238, 244 
at oo, 40 
of a real-valued function 
as x approaches x9, 34 
as x approaches oo, 40 
as x approaches —oo, 50 (Exer- 
cise 2.1.14) 
right-hand, 39 
of a sequence, 179, 292 
uniqueness of, 35, 305 
of a sum, product, or quotient, 35, 
305 
superior, left, 47 
superior of a sequence, 188 
uniform, 237 
uniqueness of, 35, 305 
Line segments in R”, 288 
Line, parametric representation of, 288- 
289 


Linear function, 325 

Linear transformation, 362 
change of content under, 490 
differential of, 367 
matrix of, 363 

Lipschitz condition, 84, 87 (Exercise 2.3.24), 

140 

Local extreme point, 80, 334 

Local extreme value, 80 

Local integrability, 152 

Local maximum point, 80, 334 

Local minimum point, 80, 334 

Locally invertible, 400 

Lower bound, 7 

Lower integral, 120, 442 

Lower sum, 120, 442 


M 
Maclaurin’s series, 264 
Magnitude, 2 
Main diagonal of a matrix, 370 
Mathematical induction, 10, 13 
Matrices 
product of, 364 
sum of, 364 
Matrix 
adjoint, 370 
of a composition of linear transfor- 
mations, 366 
differential, 367, 381 
elementary, 488 
identity, 370 
inverse, 370 
of a linear transformation, 363 
main diagonal of, 370 
nonsingular, 370 
norm of, 368 
scalar multiple of, 364 
singular, 370 
square, 368 (See p. 369) 
transpose of, 370 
Maximum value, local, 80 
Maximum of a function, 60 
Mean value theorem, 83, 347 
extended, 106 


generalized, 83 

for integrals, 138, 144 
Metric, 518 

discrete, 519 

induced by a norm, 520 
Metrics, equivalent, 529 
Metric space, 518 

complete, 527 

connected, 547 (Exercise 8.3.2) 
Minimum of a function, 60 
Minimum value, local, 80 
Minkowski’s inequality, 522 
Monotonic function, 44, 67, 84 

integrability of, 133 
Monotonic sequence, 182 
Multinomial coefficient, 322, 336 (Exer- 

cise 5.3.12) 

Multiple integral, 439 
Multiplication 

of matrices, 364 

of series, 223 

scalar, 519 
Multiplicity of a zero, 87 (Exercise. 2.3.21), 

108 (Exercises 2.5.5—2.5.7) 


N 
Natural numbers, 10 
n-ball, 290-291 
Negative definite polynomial, 353 
Negative semidefinite polynomial, 353 
Neighborhood, 21, 289, 525 
deleted, 22, 525 
deleted €, 22 
€, 2k 
Nested sets, 292, 529 
principle of, 292, 529 
Nondecreasing sequence, 182 
Nondegenerate coordinate cube, 437 
Nondenumerable set, 176 
Nonempty set, 4 
Nonincreasing sequence, 182 
Nonoscillatory at a point, 162 
Nonsingular matrix, 370 
Nontrivial solution, 375 
Norm 
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infinity, 496, 523, 524 
of a matrix, 368 
metric induced by, 520 
of a partition, 114, 437 
on a vector space, 519 
Normed vector space, 519 
nth derivative, 73 
nth partial sum of a series, 201 
nth term of a series, 201 
Number, natural, 10 
Number, prime, 15 


O 
One-sided derivative, 79 
One-sided limit, 37 
One-to-one transformation, 396 
Open ball, 525 
Open covering, 25, 293, 535 
Open interval, 21 
Open n-ball, 290 
Open set, 21, 289, 525 
Ordered field, 2 
complete, 4 
Order relation, 2 
Ordinary derivative, 317 
Ordinary integral, 439 
Origin of R”, 283 
Oscillation of a function, 171 
at a point, 172 
Oscillatory infinite series, 201 


P 
Parametric representation of a line, 288, 
289 
Partial derivative, 317 
rth order, 319 
Partial sums, 244 
Partition, 114, 437 
norm of, 114, 437 
points, 114 
refinement of, 114, 438 
Path, polygonal, 296 
Peano’s postulates, 10-11 
Piecewise continuous function, 56 
Point, 19 
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boundary, 23, 289, 526 
critical, 81, 335 
exterior, 23, 289, 526 
at infinity, 7 
interior, 21, 289 
isolated, 23, 289, 526 
limit, 23, 289, 526 
local extreme, 80, 334 
local maximum, 80, 334 
local minimum, 80, 334 
in terms of sequences, 197 
Pointwise convergence 
of a sequence of functions, 234, 238 
of a series, 244 
Pointwise limit, 234, 238, 244 
Polar coordinates, 397, 502, 505 
Polygonal path, 296 
Polygonally connected, 296 
Polynomial, 33, 98 
homogeneous, 352 
negative definite, 353 
negative semidefinite, 353 
positive definite, 353 
positive semidefinite, 353 
semidefinite, 353 
Taylor, 99, 351 
Power series, 257 
arithmetic operations with, 267 
continuity of, 260-261 
convergence of, 257 
differentiability of, 260-261 
integration of, 264 
of a product, 268 
of a reciprocal, 271 
of a quotient, 269 
uniqueness of, 263 
Prime, 15 
Principal value, 155 
Principle of mathematical induction, 11, 
14 
Principle of nested sets, 529 
Product 
Cartesian, 31, 436 (see p. 435) 
Cauchy, 226, 233 (Example 4.3.40) 
inner, 284 


of matrices, 364 

of power series, 268 

of series, 223 
Proper integral, 153 


R 

IR”, 282 (see p. 281) 

rth order partial derivative, 319 
Raabe’s test, 212 

Radius of convergence, 258 
Range of a function, 31, 32, 543 
Ratio of a geometric series, 202 
Ratio test, 210 


Rational function, 33, 232 (Exercise 4.3.28), 


276 (Exercise 4.5.4) 
Rational numbers, 2 
density of, 6 
incompleteness of, 6 
Real line, 19 
Real number system, 19 
Real-valued function, 
of n variables, 302 
of a real variable, 31 
Reals, extended, 7 
Rearrangement of series, 221 
Rectangle, coordinate, 437 
Refinement of a partition, 114, 438 
Region, 295, 297 
Region of integration, 476 
Regular transformation, 405 
Remainder in Taylor’s formula, 405 
Removable discontinuity, 58 
Restriction of a function, 399 
Riemann integrable, 114, 438 
Riemann integral 114 (see p. 113), 438 
uniqueness of, 125 (Exercise 3.1.1) 
Riemann sum, 114, 438 
Riemann-Stieltjes integral, 125 
integration by parts for, 135 (Exer- 
cise 3.2.8) 
Riemann-Stieltjes sum, 125 
Right limit inferior, 53 (Exercise 2.1.39) 
Right limit superior, 53 (Exercise 2.1.39) 
Right-hand derivative, 79 
Right-hand limit, 39 


Rolle’s theorem, 82 


S) 
Scalar multiple, 282 
Scalar multiplication, 519 
Schwarz’s inequality, 284 
Secant plane, 332-333 
Second derivative, 73 
Second derivative test, 103 
Second mean value theorem for integrals, 
144 
Sequence, 179, 526 
bounded, 181, 292 
bounded above, 181 
bounded below, 181 
Cauchy, 527 
convergence of, 179, 292, 526 
decreasing, 182 
divergent, 179 
to too, 181 
of functional values, 183 
of functions, 
pointwise, 234 
increasing, 182 
limit of, 179, 292 
uniform, 237 
limit inferior of, 188 
limit superior of, 188 
monotonic, 182 
nondecreasing, 182 
nonincreasing, 182 
nth term of, 179 
terms of, 179 
unbounded, 292 
uniformly convergent, 237 
Series 
alternating, 203 
binomial, 266 
Cauchy product of, 226, 233 (Exer- 
cise 4.3.40), 280 (Exercise 4.5.32) 
differentiability of, 252 
divergent, 201 
geometric, 202 
grouping terms in, 220 
Maclaurin, 264 


Set 


Sets 
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multiplication of, 223 

of nonnegative terms, 205 

partial sums of, 244 

power, 257 

product of, 218 

rearrangement of, 221 

Taylor, 223 

term by term differentiation of, 252 
term by term integration of, 251 
uniformly convergent, 246 


boundary of, 23, 289, 526 
bounded, 7, 536 
above, 3 
below, 7 

closed, 21, 289, 525 
closure of, 23, 289, 526 
compact, 26, 293, 536 
complement of, 20 
connected, 295 
containment of, 19 
content of, 485 
dense, 6, 29 (Example 1.3.22), 70 

(Exercise 2.2.10) 
denumerable, 176 
diameter of, 292, 536 
disconnected, 295 
empty, 4 
exterior of, 23, 289, 526 
interior of, 21, 289, 525 
nondenumerable, 176 
nonempty, 4 
open, 21, 289,525 
singleton, 20 
strict containment of, 20 
subset of, 19 
totally bounded, 538 
unbounded below, 7 
uniformly bounded, 539 
universal, 19 


disjoint, 20 
equality of, 19 
intersection of, 20 
nested, 529 
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union of, 20 
Simple zero, 108 (Exercise 2.5.5) 
Singleton set, 20 
Singular matrix, 370 
Solution of a system of linear equations 
nontrivial, 375 
trivial, 375 
Space 
metric, 518 
vector, 519 
Spherical coordinates, 507 
Square matrix, 368 (see p. 369) 
Subsequence, 195 
of a convergent sequence, 196, 527 
Subset, 19 
Subspace of a vector space, 519 
Successor, | 1 
Sum 
of matrices, 364 
Riemann, 114, 438 
lower, 120, 442 
upper, 120, 442 
Riemann-Stieltjes, 125 
of vectors, 282 
Summation by parts, 218 
Supremum 
of a function, 60, 313 
of a set, 3 
existence and uniqueness of, 4 
Surface, 331 
differentiable, 453 


T 

Tangent 
to a curve, 75 
line, 75 
plane, 332 


Taylor polynomial, 99, 351 
of a composite function, 109 (Exer- 
cise 2.5.11) 
of a product, 109 (Exercise 2.5.10) 
of a reciprocal, 110 (Exercise 2.5.12) 


for functions of n variables, 350 
for a function of one variable, 104 
Terms of a sequence, 179 
Term by term differentiation, 252 
Term by term integration, 251 
Test 
Cauchy’s root, 215 
comparison 
for improper integrals, 156 
for series, 206 
integral, 207 
Raabe, 212 
ratio, 210 
second derivative, 103 
Topological properties of R”, 282 (See 
p. 281) 
Topological space, 26 
Total variation, 134 (Exercise 3.2.7) 
Totally bounded, 538 
Transformation, 362 
affine, 380 
analytic, 416 (Exercise 6.3.17) 
continuous, 379 
differentiable, 339, 379-380 
differential of, 381 
inverse of, 396 
invertible, 396396 
linear, 362 
one-to-one, 396 
regular, 405 
Transitivity of <, 31 
Transpose of a matrix, 370 
Triangle inequality, 2, 285 
in a metric space, 518 
Triple integral, 439 
Trivial solution, 375 


U 

Unbounded 
above, 7 
below, 7 


sequence, 292 


Taylor series, 264 
convergence of, 264 
Taylor’s theorem 


Unconditional divergence, 233 (Exercise 4.3.38) 
Uniform continuity, 64, 72 (Exercises 2.2.30— 
2.2.32), 544 


for functions of n variables, 314, 392 
(Exercise 6.2.10) 
Uniform convergence 
properties preserved by 
continuity, 242 
differentiability, 243 
integrability, 242 
of a sequence, 236 
of a series, 246 
Uniformly bounded set in C [a, b], 539 
Union of sets, 20 
Uniqueness 
of infimum, 7 
of limit, 35, 305, 527 
of power series, 263 


of prime factorization, 16 (Exercise 1.2.14) 
of Riemann integral, 125 (Exercise 3.1.1) 


of supremum, 4 


Uniform continuity, 64, 66, 72 (Exercises 2.2.30- 


oe) 
Unit vector, 283 
Universal set, 19 
Upper bound, 3 
Upper integral, 120, 442 
Upper sum, 120, 442 


Vv 
Value 
of a function, 31, 32 
local maximum, 80 
local minimum, 80 
principal, 155 
Variation, total, 134 (Exercise 3.2.7) 
Vector, 283, 519 
Vector space, 283, 519 
normed, 519 
subspace of, 519 
Vector sum, 282 
Vector, unit, 283 
Vector-valued function, 362 (see p. 361) 
continuous, 379 
differentiable, 379-380 


WwW 
Weighted average, 139 
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Weierstrass’s test, 246 


Z 
Zero content, 448, 460 (Exercises 7.1.14, 
7.1.15), 461 (Exercises 7.1.16— 
7.1.19), 487, 514 (Exercise 7.3.2), 
515 (Exercise. 7.3.11) 
Zero 
multiplicity of, 108 (Exercises 2.5.5— 
2:1) 
simple 108 (Exercise 2.5.5) 
Zeroth derivative, 73 
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1 Foreword 


This is a revised version of Section 7.5 of my Advanced Calculus (Harper & Row, 
1978). It is a supplement to my textbook Introduction to Real Analysis, which is refer- 
enced several times here. You should review Section 3.4 (Improper Integrals) of that 
book before reading this document. 


2 Introduction 


In Section 7.2 (pp. 462-484) we considered functions of the form 


b 
Fo) = f je Dix 229 Sa. 


We saw that if f is continuous on [a, b] x [c, d], then F is continuous on [c, d] (Exer- 
cise 7.2.3, p. 481) and that we can reverse the order of integration in 


[ F(y) dy -[° ([' ro.n4} dy 
[ F(y) dy -[ (i fis. soar) dx 


(Corollary 7.2.3, p. 466). 
Here is another important property of F’. 


to evaluate it as 


Theorem 1 /f f and fy are continuous on |a, b] x [c,d], then 


b 
Foy = | f(x, y)dx, cx<y<d, (1) 


is continuously differentiable on [c, d| and F'(y) can be obtained by differentiating (1) 
under the integral sign with respect to y; that is, 


b 
F=f fonds, esysd. Q) 
a 
Here F'(a) and f(x, a) are derivatives from the right and F'(b) and fy(x,b) are 


derivatives from the left. 


Proof If y and y + Ay are in [c,d] and Ay # 0, then 


Fy + Ay) — FO) _ [ f(xy + Ay) - f&9) 4 


Ay Ay (3) 


From the mean value theorem (Theorem 2.3.11, p. 83), if x € [a,b] and y, y+ Ay € 
[c, d], there is a y(x) between y and y + Ay such that 


I(x, yt Ay)—f(x, vy) = fox, Ay = fox, Vx) Ay+(f (x, v(x)—fy (&, y)) Ay. 


From this and (3), 


F(y + Ay) — F(y) 


b 
~ < flier) - folds. @ 


b 
-{ cae 


Now suppose € > 0. Since /, is uniformly continuous on the compact set [a, b] x [c, d] 
(Corollary 5.2.14, p. 314) and y(x) is between y and y + Ay, there is ad > 0 such 
that if | A| < 6 then 


Ifv@.y) — fo, yx) <€, (ey) € [a, 8] x [c,d]. 
This and (4) imply that 


F(y + Ay — F(y)) 


b 
ay -| Sy (x, y) dx} < e(b—a) 


if y and y + Ay are in [c,d] and 0 < |Ay| < 6. This implies (2). Since the integral 
in (2) is continuous on [c, d] (Exercise 7.2.3, p. 481, with f replaced by f,), F’ is 
continuous on [c, d]. O 


Example 1 Since 


f(x,y) =cosxy and f,(x,y) = —xsinxy 


are continuous for all (x, y), Theorem 1| implies that if 


F(y) =| cosxydx, —0o< y <0, (5) 
0 


then = 
Foy =-f xsinxydx, -o<y<o. (6) 
0 
(In applying Theorem | for a specific value of y, we take R = [0, 2] x [—p, p], where 


p > |y|.) This provides a convenient way to evaluate the integral in (6): integrating the 
right side of (5) with respect to x yields 


a 


sinxy sin zy 
F(y)= = » VFO. 
x=0 y 
Differentiating this and using (6) yields 
% ; 
/ xsinxy dx = = es a y #0. 
0 y y 


To verify this, use integration by parts. | 


We will study the continuity, differentiability, and integrability of 


b 
Foy = | Jose ves 


where S is an interval or a union of intervals, and F is a convergent improper integral 
for each y € S. If the domain of f is [a,b) x S where —oo < a < b < ow, we say 
that F is pointwise convergent on S or simply convergent on S, and write 


b r 
[ fo. vas = tim fo fo.9ya8 @ 


if, for each y € S and every € > 0, there is an r = ro(y) (which also depends on €) 
such that 


r b 
roy - | fendx|=|[ fond}<e mosr<b  ®) 


If the domain of f is (a, b] x S where —oo <a < b < o, we replace (7) by 


b b 
[fen syax = tim, [fey ax 


and (8) by 


= <€, a<r<ro(y). 


b 
FQ) - / Fees 


[ fe.nax 


In general, pointwise convergence of F' for all y € S does not imply that F is 
continuous or integrable on [c, d], and the additional assumptions that f;, is continuous 


and [' i Fy (x, y) dx converges do not imply (2). 


Example 2 The function 
f(x,y) = ye DP 


is continuous on [0, 00) x (—oo, oo) and 


F(y) = [ f(x. y)dx = [ ye dx 


converges for all y, with 


-1 y<0O, 
F(y)=7; 0 y=0, 
1 y>0O; 


therefore, F is discontinuous at y = 0. 


Example 3 The function 
fapave”* 


is continuous on [0, co) x (—oo, 00). Let 
Co Co 2 
Fo) = | foydx = f yee *dx=y, -0o<y<oo. 
0 0 


4 


Then 
F'(y)=1, -o<y<o. 


However, 


1, y £0, 


i pore) ax = f (By? —2y4x)e"™ dx = 
o dy 0 0, y=0, 


sO 


af (x, y) _ y) 


Foye [> dx if y=0. 


3 Preparation 


We begin with two useful convergence criteria for improper integrals that do not involve 
a parameter. Consistent with the definition on p. 152, we say that f is locally integrable 
on an interval / if it is integrable on every finite closed subinterval of J. 


Theorem 2 (Cauchy Criterion for Convergence of an Improper Integral I) Suppose 
g is locally integrable on [a, b) and denote 


G(r) =f seoas, a<r<b. 


Then the improper integral ih g(x) dx converges if and only if, for each € > 0, there 
isan ro € [a,b) such that 


IGir)-Girp)l<¢e, rosnn<b. (9) 


Proof For necessity, suppose . g(x)dx = L. By definition, this means that for 
each € > 0 there is an ro € [a, b) such that 


|IG(r) -—L| < - and |G(r1)—L| < =: ro < 7,71 <b. 
Therefore 


IG(r) — G(r1)| 


II 


(G(r) — L) —(G(r1) — L)| 
IG(r) — L| + |G() —L| <€, ro<rrn <b. 


IA 


For sufficiency, (9) implies that 
IG()| = |G@1) + (Gr) — G1) < IEC + IG) — Gv) Ss IG@)| + €. 


ro <r <r, <b. Since G is also bounded on the compact set [a, ro] (Theorem 5.2.11, 
p. 313), G is bounded on [a, b). Therefore the monotonic functions 


G(r) = sup {G(r1) | r<rj< b} and G(r) = inf {G(r1) | r<r< b} 


are well defined on [a, b), and 
lim G(r) =L and lim G(r) =L 
r>b— r—>b— 


both exist and are finite (Theorem 2.1.11, p. 47). From (9), 


II 


IG) — Gir1)| (G(r) — G(r0)) — (G(r1) — G(ro))| 


IG(r) — G(ro)| + |G(r1) — G(ro)| < 2€, 


A 


50 
G(r) —G(r) <2e, ro <r <b. 


Since € is an arbitrary positive number, this implies that 
au (G(r) — G(r)) = 0, 
r—>b— 


sol = L.LetL = L = L. Since 
G(r) < G(r) < G(r), 


it follows that lim,_.,- G(r) = L. O 
We leave the proof of the following theorem to you (Exercise 2). 


Theorem 3 (Cauchy Criterion for Convergence of an Improper Integral II) Suppose 
g is locally integrable on (a, b| and denote 
b 
G(r) = g(x)dx, ax<r<b. 
r 
Then the improper integral fe g(x) dx converges if and only if, for each € > 0, there 
isan ro € (a, b] such that 
IG(r) —G(n1)| <€, a<rri <7o. 


To see why we associate Theorems 2 and 3 with Cauchy, compare them with The- 
orem 4.3.5 (p. 204) 


4 Uniform convergence of improper integrals 
Henceforth we deal with functions f = f(x, y) with domains J x S, where S is an 
interval or a union of intervals and J is of one of the following forms: 

e [a,b) with-co <a<b<o@; 

e (a, b] with—-co <a<b<o; 


e (a,b) with—co <a <b<ov. 


In all cases it is to be understood that f is locally integrable with respect to x on J. 


When we say that the improper integral . F(x, y) dx has a stated property “on S” we 
mean that it has the property for every y € S. 


Definition 1 /f the improper integral 
b r 
/ F(x, y)dx = lim / F(x, y)dx (10) 
a r—>b—Jq 


converges on S, it is said to converge uniformly (or be uniformly convergent) on S if, 
for each € > 0, there is an ro € [a, b) such that 


<e, yesS, rox<r<b, 


[ fle. ydx =f fox. y)ds 


or, equivalently, 


<e, yeS, m<r<b. (11) 


/ " Peiide 


The crucial difference between pointwise and uniform convergence is that ro(y) in 
(8) may depend upon the particular value of y, while the ro in (11) does not: one choice 
must work for all y ¢ S. Thus, uniform convergence implies pointwise convergence, 
but pointwise convergence does not imply uniform convergence. 


Theorem 4 (Cauchy Criterion for Uniform Convergence I) The improper integral 
in (10) converges uniformly on S if and only if, for each € > 0, there is an ro € [a, b) 
such that 


<e, yesS, ro<rrn<b. (12) 


Lr fle, y)dx 


Proof Suppose / : F(x, y) dx converges uniformly on S and € > 0. From Defini- 
tion 1, there is an rg € [a, b) such that 


[ fle, y)dx [ fx, y)dx 


oe and 
2 


<5. yeS, m<nn <b. (13) 


Since " ; 
/ foyax =f fox yydx— f flax. y) dx, 


(13) and the triangle inequality imply (12). 
For the converse, denote 


Fi) = / f(x. y)dx. 


Since (12) implies that 
IFiny=Fri.yi<¢ yes, mann <4, (14) 


Theorem 2 with G(r) = F(r, y) (y fixed but arbitrary in S) implies that ie F(x, y) dx 
converges pointwise for y € S. Therefore, if ¢ > 0 then, for each y € S, there is an 
ro(y) € [a, b) such that 


b 
[ fo.nax <e, yes, ro(y)<r<b. (15) 


For each y € S, choose r1(y) => max[ro(y), ro]. (Recall (14)). Then 


b ri(y) b 
/ fade =| fe. y)az +f ear es 
r r riQy) 


so (12), (15), and the triangle inequality imply that 


<2e, yeS, ro<r<b. 


/ j6ne 


O 
In practice, we don’t explicitly exhibit rp for each given e. It suffices to obtain 
estimates that clearly imply its existence. 


Example 4 For the improper integral of Example 2, 


/ fe, ydx| = / pie tease. 926. 


r 


If |y| = p, then 


<e, 


[O fe.nas 


so Io” F(x, y) dx converges uniformly on (—oo, p] U [p, co) if p > 0; however, it 
does not converge uniformly on any neighborhood of y = 0, since, for any r > 0, 
els 5 if |y| is sufficiently small. 


Definition 2 /[f the improper integral 


b b 
/ f(x, y)dx = tim, i fx, ydx 


converges on S, it is said to converge uniformly (or be uniformly convergent) on S if, 
for each € > 0, there is an ro € (a, b] such that 


<e, yeS, a<r<ro, 


[ fee nar [fee r)ax 


or, equivalently, 


<e, yeS, a<r<ro. 


[ fe.nas 


We leave proof of the following theorem to you (Exercise 3). 


Theorem 5 (Cauchy Criterion for Uniform Convergence II) The improper integral 


b b 
/ f(x, y)dx = tim, / fx y)dx 


converges uniformly on S if and only if, for each € > 0, there is an ro € (a, b] such 
that 


<e, yesS, a<r,r, <1. 


i Fe, yx 


We need one more definition, as follows. 


Definition 3 Let f = f(x, y) be defined on (a,b) x S, where -co <a<b<o. 
Suppose f is locally integrable on (a, b) for all y € S and let c be an arbitrary point 
in (a, b). Then i, F(x, y) dx is said to converge uniformly on S if fr F(x, y) dx and 


vi F(x, y) dx both converge uniformly on S. 


We leave it to you (Exercise 4) to show that this definition is independent of c; 


that is, if .. f(x, y) dx and : F(x, y) dx both converge uniformly on S for some 
c € (a,b), then they both converge uniformly on S for every c € (a, b). 
We also leave it you (Exercise 5) to show that if f is bounded on [a, b] x [c, d] 


and fia F(x, y) dx exists as a proper integral for each y € [c,d], then it converges 
uniformly on [c, d] according to all three Definitions 1-3. 


Example 5 Consider the improper integral 


oe) 
F(y) =i ge dx, 
0 


which diverges if y < 0 (verify). Definition 3 applies if y > 0, so we consider the 
improper integrals 


1 loo) 
Fi(y) =) x V/2e%Y dx and Fo(y) = i x Ae 8) dx 
0 1 


separately. Moreover, we could just as well define 


Cc le ) 
Fi(y) -| xV/2e-*) dx and Fo(y) =} greet i (16) 
0 


c 


where c is any positive number. 
Definition 2 applies to F;. If 0 <r; <r and y > 0, then 


ry) 
/ x 2e-XY dx 
. 


so F,(y) converges for uniformly on [0, oo). 


5 
<| x2 dx < ar'/2, 
ry 


Definition | applies to Fy. Since 


ry 
i ge ds, 
, 


F(y) converges uniformly on [p, 00) if p > 0. It does not converge uniformly on 
(0, p), since the change of variable u = xy yields 


Lal 1 1 r1y 1 
7 gee Sy op ye" aad, 
r ry 


—ry 


~ e 
< ‘ea! e* dx = Ta, 
r yr 


which, for any fixed r > 0, can be made arbitrarily large by taking y sufficiently small 
and r = 1/y. Therefore we conclude that F(y) converges uniformly on [p, 00) if 
p>o. 

Note that that the constant c in (16) plays no role in this argument. 


Example 6 Suppose we take 


6a 
/ sin u ieee a (17) 
0 
as given (Exercise 31(b)). Substituting uw = xy with y > 0 yields 


oO 
/ ae gee SU, (18) 
0 x 2 


What about uniform convergence? Since (sin xy)/x is continuous at x = 0, Defini- 
tion | and Theorem 4 apply here. If 0 < r < ry and y > 0, then 


- sinxy ieee cos xy +f" COsxXY a) oo in sinxy dx Pes 
r x y x r r x? r x ry” 


Therefore (18) converges uniformly on [p, 00) if p > 0. On the other hand, from (17), 
there is a 5 > O such that 


ee 
[ aur F, osu <6. 
7 4 

This and (18) imply that 


CO a3 OO as 
sin xy sinu 1 
/ dx = / du>— 
- x yr OU 4 


for any r > Oif 0 < y < 6/r. Hence, (18) does not converge uniformly on any interval 
(0, p] with p > 0. 
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5 Absolutely Uniformly Convergent Improper Integrals 


Definition 4 (Absolute Uniform Convergence I) The improper integral 


b r 
[ fenax = tim fo fo.nas 


is said to converge absolutely uniformly on S if the improper integral 


b r 
[ ire lax = tim fife. vax 


converges uniformly on S; that is, if, for each € > 0, there isan ro € [a, b) such that 


<e, yeS, rmo<r<b. 


b r 
iy Ic »)ldx ~ f Lf Ge, yl dx 


To see that this definition makes sense, recall that if f is locally integrable on [a, b) 
for all y in S, then so is | f| (Theorem 3.4.9, p. 161). Theorem 4 with f replaced by 


| f| implies that : F(x, y) dx converges absolutely uniformly on S if and only if, for 
each € > 0, there is an ro € [a, b) such that 


ry 
/ |f(x,y)|}dx <e, yeS, m<r<n<b. 
- 


Since 


i eae 


=| If@, Idx, 


Theorem 4 implies that if i F(x, y) dx converges absolutely uniformly on S then it 
converges uniformly on S. 


Theorem 6 (Weierstrass’s Test for Absolute Uniform Convergence I) Suppose M = 
M(x) is nonnegative on [a, b), a M(x) dx < oo, and 


If(x.y)|< M(x), yeS, a<x<b. (19) 
Then qe F(x, y) dx converges absolutely uniformly on S. 


Proof Denote / i M(x)dx = L < o. By definition, for each « > 0 there is an 
ro € [a, b) such that 


F 
L-e<| M(x)dx <L, ro<r<b. 
a 


Therefore, if 79 <r <7r,, then 


os [ M(x) dx = (f° meyax—1)-( f° moar —z) <e 


11 


This and (19) imply that 
ry r| 
| Pe idx sf M(x)dx <e, yeS, a<rm<r<n<b. 
r r 


Now Theorem 4 implies the stated conclusion. Oo 


Example 7 Suppose g = g(x, y) is locally integrable on [0, oo) for all y € S and, for 
some dp = 0, there are constants K and po such that 


lg(x, y)| < Ke?*, yeS, x>apo. 


If p > po andr > ao, then 


II 


lo.) 
/ e@7 (P—POIX POX | g(x, y)| dx 


r 


/ e* Lex, y)| dx 


Ke7-Po)r 


A 


Cc 
x | eo P-PO* dy = 
r P— Po 


so i e ?* g(x, y) dx converges absolutely on S. For example, since 
|x* sinxy| <e?°* and |x*cosxy| < e?* 


for x sufficiently large if po > O, Theorem 4 implies that i e P*x® sinxy dx 
and oe e P* x* cos xy dx converge absolutely uniformly on (—oo, co) if p > 0 and 
a > 0. Asa matter of fact, fay e ?*x” sin xy dx converges absolutely on (—oo, 00) 
if p > O anda > —1. (Why?) 


Definition 5 (Absolute Uniform Convergence II) The improper integral 


b b 
[ fe. yax = tim, [fey ax 


is said to converge absolutely uniformly on S if the improper integral 


b b 
[ \remlax = tim, [fe n)ax 


converges uniformly on S; that is, if, for each € > 0, there is an ro € (a, b| such that 


<e, yeS, a<r<rnmo<b. 


b b 
[ \reniax— f LF, lax 


We leave it to you (Exercise 7) to prove the following theorem. 


Theorem 7 (Weierstrass’s Test for Absolute Uniform Convergence II) Suppose 
M = M(x) is nonnegative on (a, bl, ( M(x) dx < oo, and 


If(x,y)|< M(x), yeS, x€eG,d]. 


Then fi F(x, y) dx converges absolutely uniformly on S. 
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Example 8 If g = g(x, y) is locally integrable on (0, 1] for all y € S and 
lg(x, y)| < Ax78, O<x <x0, 
for each y € S, then 
p x 9(x, y)dx 


converges absolutely uniformly on S if a > 6 — 1. To see this, note that if0 <r < 
Tr, < Xo, then 


Ax%-B+1 r Ar&B+! 


r r 
x*|g(e. dx oA f xtPdx =) <2 
I, r gape.’ w= pl 


Applying this with 6 = 0 shows that 


1 
F(y) = | x” cosxy dx 
0 


converges absolutely uniformly on (—oo, 00) if a > —1 and 


1 
cu) = | x” sinxy dx 
0 


converges absolutely uniformly on (—oo, 00) if a > —2. 


By recalling Theorem 4.4.15 (p. 246), you can see why we associate Theorems 6 
and 7 with Weierstrass. 


6 Dirichlet’s Tests 


Weierstrass’s test is useful and important, but it has a basic shortcoming: it applies 
only to absolutely uniformly convergent improper integrals. The next theorem applies 


in some cases where [ f(x, y) dx converges uniformly on S, but : | f(x, y)| dx 
does not. 


Theorem 8 (Dirichlet’s Test for Uniform Convergence I) /f g, gx, and h are con- 
tinuous on [a, b) x S, then 


b 
J ste.rynee. »yax 
a 
converges uniformly on S if the following conditions are satisfied: 
(a) lim 4 sup|g(x, y)|¢ = 0; 
x—>b— yes 
(b) There is a constant M such that 


<M, a<x<b; 


ik h(u, y) du 


sup 
yes 
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(c) is |gx(x, y)| dx converges uniformly on S. 


Proof If x 
HG) = i h(u, y) du, (20) 


then integration by parts yields 


/ e(e, yh(x, y) dx / e(x, )) He, ») dx 
gn, WA. y)-g@ yA, y) (21) 


-| &x(x, y)H(x, y) dx. 


II 


Since assumption (b) and (20) imply that | H(x, y)| < M, (x, y) € (a, b] xS, Eqn. (21) 
implies that 


/ g(x, h(x, ») dx 


r| 
<M (2suplecesi+ f[ lexcesidx) — @2 
x>r r 
on [r, ry] x S. 
Now suppose « > 0. From assumption (a), there is an 79 € [a,b) such that 


lg(x, y)| < € on S if ro < x < b. From assumption (c) and Theorem 6, there is 
an so € [a, b) such that 


r| 
/ lgx(x,y)|dx <e, yeS, so<r<rn <b. 
- 
Therefore (22) implies that 


<3Me, yeéS, max(ro,50)<r<r, <b. 


| / ee, yh, 9) 


Now Theorem 4 implies the stated conclusion. O 

The statement of this theorem is complicated, but applying it isn’t; just look for a 
factorization f = gh, where h has a bounded antderivative on [a, b) and g is “small” 
near b. Then integrate by parts and hope that something nice happens. A similar 
comment applies to Theorem 9, which follows. 


Example 9 Let 
[e,) 
1y) = f eu y>0o. 
o x+y 


The obvious inequality 


cos xy | _ 1 
x+y} x+y 


, dx 
=o. 
o x+y 
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is useless here, since 


However, integration by parts yields 
: COSXY sinxy |"! +f sin xy ~ dx 
r x+y yx+y)l, Jr ye +y) 
sinryy sinry [ sin xy 
—_——— —- ——_ ———., dx. 
yrit+y) yart+y) Jr ye ty)? 


Therefore, if 0 <r < r,, then 


"l cosxy 1 2 a 1 3 3 
dx| < — | —— + Fo aad | saa ee 
r x+y y\r+y Jr (@&+Y) yr +yy ~ pir +p) 
if y > p > 0. Now Theorem 4 implies that /(y) converges uniformly on [p, oo) if 
p>0. 


We leave the proof of the following theorem to you (Exercise 10). 


Theorem 9 (Dirichlet’s Test for Uniform Convergence II) /f g, g,, and h are con- 
tinuous on (a, b] x S, then 


b 
J s.rnee pax 
a 
converges uniformly on S if the following conditions are satisfied: 
(a) lim, 9 sup |g(x, yp = 0; 
x->at+ yes 


(b) There is a constant M such that 


sup 2M, atau 


yes 


b 
/ h(u, y)du 


(c) rs |gx(x, y)| dx converges uniformly on S. 
By recalling Theorems 3.4.10 (p. 163), 4.3.20 (p. 217), and 4.4.16 (p. 248), you 


can see why we associate Theorems 8 and 9 with Dirichlet. 
7 Consequences of uniform convergence 


Theorem 10 /f f = f(x, y) is continuous on either [a, b) x [c, d] or (a, b] x [c, d] 
and 


b 
FQ) = / fe, yaz (23) 


converges uniformly on [c,d], then F is continuous on |c, d]. Moreover, 


[ ([' 10.) r= ['([' sone) dx. (24) 
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Proof We will assume that f is continuous on (a, b] x [c,d]. You can consider the 
other case (Exercise 14). 

We will first show that F in (23) is continuous on [c,d]. Since F converges uni- 
formly on [c,d], Definition 1 (specifically, (11)) implies that if « > 0, there is an 
r € [a, b) such that 


/ “Ge iias 


<é€, c<yK<d. 


Therefore, if c < y, yo < d], then 


b b 
FQ) —FOo| = | i fa. yydx — i fle yo) dx 
r b 
< i LG, 9) — fe, yo) az| + / fx. ydx 
b 
+// F(x, yo) dx}, 
sO ; 
IF(y) — FOvo)| < i Lf. 9) — fe, yo) dx +26. (25) 


Since f is uniformly continuous on the compact set [a, r] x[c, d] (Corollary 5.2.14, 
p. 314), there is ad > O such that 


If.) — F(, yo)| <€ 
if (x, y) and (x, yo) are in [a,r] x [c, d] and |y — yo| < 6. This and (25) imply that 
|F() — F(vo)| < (F — ae + 2€ < (6 —a + 2)e 


if y and yo are in [c, d] and |y — yo| < 6. Therefore F is continuous on [c, d], so the 
integral on left side of (24) exists. Denote 


I -[° ([' sora] dy. (26) 


We will show that the improper integral on the right side of (24) converges to J. To 


this end, denote 
r d 
I(r) = / (/ F(x, y) iv) dx. 


Since we can reverse the order of integration of the continuous function f over the 
rectangle [a, r] x [c, d] (Corollary 7.2.2, p. 466), 


I(r) = [ (f fy) ax) dy. 
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From this and (26), 


r= f° ([' e.nes) d 


Now suppose € > 0. Since i F(x, y) dx converges uniformly on [c, d], there is an 
ro € (a, b] such that 


<€, ro<r<b, 


/ Core 


so |J —I(r)| < (d —c)e ifro < r < b. Hence, 


sim fo ([" fs. say] ava fe (i fs. s)a] dy, 


which completes the proof of (24). Oo 


Example 10 It is straightforward to verify that 


v7 1 
i e dx =-, y>0O, 
0 y 


and the convergence is uniform on [p, oo) if p > 0. Therefore Theorem 10 implies that 
if 0 < yy < y2, then 


y2 dy y2 oo oo y2 
/ ee, i (/ e ax) dy -| (/ e ay) dy 
vn (OY yi 0 0 V1 
[ eXY1 — eW*V2 

0 


\ 2 2 = los, y2=y>09, 
vy (OW 


e 
——— dx. 
xX 


II 


Since 


it follows that 
©O p-XY1 _ p—Xxy2 
/ ee dx = lon. y2>y1 > 0. 
0 x 1 


Example 11 From Example 6, 


oe 
? Oe ee, psi 
0 XxX 2 


and the convergence is uniform on [p, 00) if o > 0. Therefore, Theorem 10 implies 
that if 0 < y; < y2, then 


ie ([* sin xy ax) _ [ (is sinxy ay) He 
y1 0 x 0 y1 “ 


°° cos xy, — cos xyz 
a, dx. 
0 Xx 


II 


a 
02 —y1) 


II 


(27) 
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The last integral converges uniformly on (—oo, oo) (Exercise 10(h)), and is therefore 
continuous with respect to y; on (—oo, 00), by Theorem 10; in particular, we can let 
yy — 0+ in (27) and replace y2 by y to obtain 


°° 1—cosxy wy 
——__ dx = =, > 0. 
[ x? 7 2 — 


The next theorem is analogous to Theorem 4.4.20 (p. 252). 
Theorem 11 Let f and fy be continuous on either [a, b) x [c,d] or (a, b] x [c, d]. 


Suppose that the improper integral 


b 
F(y) = i, fa. pdx 


converges for some yo € [c,d] and 


b 
GQ) = / fot, y) dx 


converges uniformly on [c,d]. Then F converges uniformly on [c, d] and is given ex- 
plicitly by 


y 
FQ) =Foo)+ f G@d ceysd. 
YO 
Moreover, F is continuously differentiable on |c, d]; specifically, 
F'(y) =G0Q), esysd, (28) 


where F’(c) and fy(x,c) are derivatives from the right, and F’(d) and f,(x,d) are 
derivatives from the left. 


Proof We will assume that f and f, are continuous on [a,b) x [c,d]. You can 
consider the other case (Exercise 15). 
Let 


. 
FOy= ff fl.yds, asr<b, csysd, 
a 
Since f and fj are continuous on [a, r] x [c, d], Theorem 1 implies that 
r 
Fo) =f fsdx, csy ed. 
a 


Then 


y F ad 
FQ) = Fr(yo) + f (/ fr(x.1) dx) a 
yo a 


F(vo) + ° G(t) dt 


y b 
+(F-(0) — FO) — f (/ fuesnds) ie ep Sat 
yo r 
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Therefore, 


< |Fr(yo) — Fo)! 


in [ fle, t)dx 


Now suppose € > 0. Since we have assumed that lim,_,,— F+(vo) = F (yo) exists, 
there is an ro in (a, b) such that 


y 
F,(y) — F(yo) - 1 G(t) dt 


yO 


+ dt. (29) 


|F-(vo) - FQ0)| <€, To<r <b. 


Since we have assumed that G(y) converges for y € [c, d], there is an r1 € [a, b) such 
that 


<e, teéle,d], m<r<b. 


b 
/ Sy (x, t) dx 


Therefore, (29) yields 


sel |y =o) Se(l--d =<) 


y 
F,(y) — F(¥) — / Git) dt 
yo 


if max(ro,71) <r < bandt € [c,d]. Therefore F(y) converges uniformly on [c, d] 
and 


FO = Food| CBdy ee yea 


vO 
Since G is continuous on [c, d] by Theorem 10, (28) follows from differentiating this 
(Theorem 3.3.11, p. 141). Oo 


Example 12 Let 
Co 
I(y) =f ee dx, y>O. 
0 


r 1 rJ/y 
' e** dx = — | et dt, 
0 JY Jo 


1 S 2 
I ==] e dt, 
° VY Jo 


and the convergence is uniform on [p, oo) if p > 0 (Exercise 8(i)). To evaluate the last 
integral, denote J(p) = i e? dt; then 


p po, P pp 
J?(p) = (/ ew au) (/ ev dv) = i, ic e407) dy dy, 
0 0 o Jo 


Transforming to polar coordinates r = r cos 6, v = r sin yields 


n/2 pp _ 4—p2 rae =e-P*) 
Pop = | if re? drdg = 7C 8), so. J(p) = ————__. 


2 


Since 


it follows that 
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Therefore 


oo 7 / a) 1 
i Pa dt = lim J(p) = NE and / gow dx =~ i y>0. 
0 poo 2 0 2Vy 


Differentiating this n times with respect to y yields 


00 1GuOn 4 
/ er ee We yO, 1,03) ac, 
0 Qnynt1/2 


where Theorem 11 justifies the differentiation for every n, since all these integrals 
converge uniformly on [p, oo) if p > 0 (Exercise 8(1)). 


Some advice for applying this theorem: Be sure to check first that F(vo) = 
f i f(x, yo) dx converges for at least one value of y. If so, differentiate is F(x, y) dx 


formally to obtain fc Sy(x, y) dx. Then F’(y) = iC Sy (x, y) dx if y is in some 
interval on which this improper integral converges uniformly. 


8 Applications to Laplace transforms 
The Laplace transform of a function f locally integrable on [0, oo) is 


F(s) = T. e ** f(x) dx 


for all s such that integral converges. Laplace transforms are widely applied in mathe- 
matics, particularly in solving differential equations. 
We leave it to you to prove the following theorem (Exercise 26). 


Theorem 12 Suppose f is locally integrable on [0, co) and | f(x)| < Me for suf- 
ficiently large x. Then the Laplace transform of F converges uniformly on [s1, 00) if 
Sy, > So. 


Theorem 13 /f f is continuous on [0, 00) and H(x) = ‘ea e 80% F(u) du is bounded 
on [0, 00), then the Laplace transform of f converges uniformly on [s1, 00) if 51 > So. 


Proof If0<r<r, 
r| Fl " 
i e* f(x)dx = / eo E-80)% ¢807 F(x) dt = i e8 H(x) dt. 
r r sf 


Integration by parts yields 


r| ial 
+ (s— so) [ e 8-80) H(x) dx. 
r 


r 


r| 
/ e®* f(x) dt = e~S-%0)* H(x) 
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Therefore, if |H(x)| < M, then 


i e®* f(x) dx 


IA 


M 


oe S—S0)r1 4 e780) a (s =) [ eo S-s0)x dx 
r 


IA 


3Me—S-50)" < 3Me—S1-80)"_ gs > sy, 


Now Theorem 4 implies that F(s) converges uniformly on [s1, 00). 
The following theorem draws a considerably stonger conclusion from the same 
assumptions. 


Theorem 14 /f f is continuous on [0, 00) and 


A(x) = 1 e °™ Flu) du 


is bounded on [0, 00), then the Laplace transform of f is infinitely differentiable on 
(sg, CO), with 


Co 
F™(s) = (-1)” i: e* x" f(x) dx; (30) 
0 
that is, the n-th derivative of the Laplace transform of f(x) is the Laplace transform 
of (—1)"x" f (x). 
Proof First we will show that the integrals 


In(s) = | e **x" f(x)dx, n=0,1,2,... 
0 


all converge uniformly on [s1, 00) if 5; > so. If0 <r < 7rj, then 


r| r| r| 
i e **x" f(x) dx = / e S-80)¥ o-50* x" F(x) dx = / e S~S0)* ¥" H'(x) dx. 
r r r 


Integrating by parts yields 


r] 
/ e **x" f(x)dx = r@e—S-s0)"! H(r) _ re 8-50)" H(r) 
- 


-[ A(x) (ee x") dx, 


where ’ indicates differentiation with respect to x. Therefore, if |H(x)| < M <ooon 
[0, oo), then 


[ e *x" f(x) dx 


<M ete +4 ee S—50)r pn +4 , |(e~S-80)*) 7)! ax) : 


r 


Therefore, since e~ 50)" -” decreases monotonically on (1, 00) if s > so (check!), 


im e **x" f(x) dx 


<3Me S90" "oa ner<n, 


so Theorem 4 implies that J, (s) converges uniformly [s1, 00) if 51 > so. Now The- 
orem 11 implies that F,+; = —F,/, and an easy induction proof yields (30) (Exer- 
cise 25). Oo 
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Example 13 Here we apply Theorem 12 with f(x) = cosax (a # 0) and so = 0. 


Since 


ae sinax 
cosaudu = 
0 a 


is bounded on (0, co), Theorem 12 implies that 
[o,) 
F(s) = / e ** cosax dx 

0 
converges and 

[oe 

F(s) = cy" f e *x"cosaxdx, s>O0. 
0 


(Note that this is also true if a = 0.) Elementary integration yields 


F(s) = ——>.. 
(s) s? + a? 
Hence, from (31), 
a d" Ss 
SX \.n =_ | n ——., = 0,1, 
i e **x" cosax = (-1) Ae ae n 
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(31) 


9 Exercises 
1. Suppose g and / are differentiable on [a, b], with 
ax<gy)<b and axh(y)<b, cx<yXd. 


Let f and f, be continuous on [a, b] x [c, d]. Derive Liebniz’s rule: 


d rh 
rr f(x,y)dx = fih(y), y)h'(y) — f(g0), yg’) 
Y Je(y) 
hy) 
+ Sy (x, y) dx. 
g(y) 


(Hint: Define H(y, u,v) = t F(x, y) dx and use the chain rule.) 
2. Adapt the proof of Theorem 2 to prove Theorem 3. 


3. Adapt the proof of Theorem 4 to prove Theorem 5. 


4. Show that Definition 3 is independent of c; that is, if is F(x, y) dx and i. F(x, y)dx 
both converge uniformly on S for some c € (a, b), then they both converge uni- 
formly on S and every c € (a,b). 


5. (a) Show that if f is bounded on [a, b] x [c, d] and c F(x, y) dx exists as a 
proper integral for each y € [c,d], then it converges uniformly on [c, d] 
according to all of Definition 1-3. 

(b) Give an example to show that the boundedness of f is essential in (a). 


6. Working directly from Definition 1, discuss uniform convergence of the follow- 
ing integrals: 


—xy 2 
@ | 7 oe rare dx OF e ~*x* dx 
© | xe I™” dy @ | sin xy? dx 
0 0 


Co lo.) 
(e) / (By? — 2xy)e? * dx (f) / Qzy=y' ae? dx 
0 0 
7. Adapt the proof of Theorem 6 to prove Theorem 7. 


8. Use Weierstrass’s test to show that the integral converges uniformly on S : 


(a) / e sinxdx, S=[p,c), p>0 
0 


wo | de Na ledl tee ee <2 
0 x” 
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10. 


11. 


12. 


(i) 


(b) 


(c) 
(d) 


a . 
/ onal dx, p>0O, S = (-—o,0co) 
1 


1 ery 4 
[ G—-x Xx, S = (—oo, b), b<1 


cos xy _ 


7 ax, S=(—-oco,—-p]U[p, co), p>d. 
L4x2y2 y? 


e*/? dx, S=[p,c0), p>0 


8a 


sured ela d s=( ) 
x, = (—00, 00 


Ee 
J. 
[fe “dx, S=[-p,pl p>0 
I 
a 


x2 ene? dx, S=[p,o), p>0, n=0,1, 2... 


Show that 
[o.e} 
TQ) =i x? Je dx 
0 


converges if y > 0, and uniformly on [c,d] if0 <c <d <o. 
Use integration by parts to show that 


and then show by induction that 


ry +n) 


ro) = ——__* 
wo =D 


VSO, n= 1,2,3.0004 


How can this be used to define ["(y) in a natural way for all y 4 0, —1, 
—2,...? (This function is called the gamma function.) 


Show that '(n + 1) = n! if n is a positive integer. 
Show that 


[o,@) 
/ ef dt =s Pres), @«>=1, 520 
0 


Show that Theorem 8 remains valid with assumption (c) replaced by the as- 
sumption that |g. (x, y)| is monotonic with respect to x forall y € S. 


Adapt the proof of Theorem 8 to prove Theorem 9. 


Use Dirichlet’s test to show that the following integrals converge uniformly on 
S = [p, 00) if p > 0: 
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13. 


14. 


15. 


16. 


17. 


18. 


ca [ sin xy iu w | sin xy cs 
1 xy 2 Ilogx 


cos xy sinxy | 
© f- x+y Bae @ fo Coa 


Suppose g, gx and / are continuous on [a,b) x S, and denote H(x,y) = 
Je hu, y) du, a < x < b. Suppose also that 


x—>b— 


b 
lim | sup |g (x, y)H(x, ny =0 and i &x(x, vy) A(x, y) dx 
yeS a 


converges uniformly on S. Show that // ei g(x, y)h(x, y) dx converges uniformly 
on S. 


Prove Theorem 10 for the case where f = f(x, y) is continuous on (a, b] x 


[c,d]. 


Prove Theorem |1 for the case where f = f(x, y) is continuous on (a, b] x 


[c,d]. 
Show that 
C(y) = F(x)cosxydx and S(y) = a f(x) sin xy dx 


are continuous on (—oo, oo) if 
[oe 
i | f(x)| dx < oo. 
—oo 
Suppose f is continuously differentiable on [a, 00), limy;—o0 f(x) = 0, and 


/ | f'(x)|dx < o. 
Show that the functions 
C(y) = | F(x)cosxydx and S(y) =| f(x) sinxy dx 


are continuous for all y 4 0. Give an example showing that they need not be 
continuous at y = 0. 


Evaluate F(y) and use Theorem 11 to evaluate J: 


ad dx © tan-! ax — tan7! bx 
F = ——,, x 0; I = pe eee, d : 
(a) FO) [ 1+ y?x? ” i: x . 


a,b>0 
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19. 


20. 


21. 


22. 


(b) Fo) = | x* dx,y > 1; r=f 
0 0 


(c) Fo) = | e *cosxdx, y>0O 
0 


00 pax — ex 
l= ————— cos 
0 xX 


(a) FQ) = / asin wah 
0 


oO ,—-ax —bx 
e =e 2 
I =| —__— sinx dx, 
0 


x 


(e) Fo) = | e “sinxy dx; r=[ e 
0 0 


(f) Fo) = | e*cos.xydx; = f e 
0 0 


Use Theorem 11 to evaluate: 


x? —x 
log x 
xdx, a,b>0O 
» yO 
a,b>0 


x 


1 
(a) / (logx)’x* dx, y>-l, n=0,1,2,.... 
0 


(b) [ dx 1 
» Get yt x, y 


(c) / x2Rt1 “IX? dy -y > 0, 
0 


CO 
@ [ xy*dx, O<y<l. 
0 


>0, n=0,1,2,.... 


x 


_, sinax 


n=0, 1, 2,.... 


_, 1 —cosax d 


dx 


(a) Use Theorem [1 and integration by parts to show that 


2 2 
Foy = | e ~*~ cos2xy dx 
0 


satisfies 


(b) Use part (a) to show that 


Show that 


= 2 2 y 
/ e ~*~ sin2xydx =e” / 
0 0 


(Hint: See Exercise 20.) 


State a condition implying that 


F'+2yF =0. 
F(y) = ae 


ew 


du. 


x 


a,b>-l 


C(y) = [ f(x)cosxydx and S(y) = ia F(x) sinxy dx 
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23. 


24. 


25. 


26. 


27. 


28. 


29. 


are n times differentiable on for all y # 0. (Your condition should imply the 
hypotheses of Exercise 16.) 


Suppose f is continuously differentiable on [a, 00), 
CO 
[let feoylax<oo, Osk en, 
a 


and lim; 90 x” f(x) = 0. Show that if 


C(y) = [ f(x)cosxydx and S(y) = [ f(x) sinxy dx, 
then 
CMG) = [#70 cosxydx and Sy) = [#10 sinxy dx, 
O<k<n. 


Differentiating 
= ee 
F(y)= cos — dx 
1 xX 


under the integral sign yields 
CO 
1 
— i — sin y dx, 
1 x x 


which converges uniformly on any finite interval. (Why?) Does this imply that 
F is differentiable for all y? 


Show that Theorem |1 and induction imply Eq. (30). 
Prove Theorem 12. 


Show that if F(s) = iP. e ** f(x) dx converges for s = So, then it converges 
uniformly on [so, 00). (What’s the difference between this and Theorem 13?) 


Prove: If f is continuous on [0, oo) and 5 e *0* f(x) dx converges, then 


lim e* f(x)dx = / e * F(x) dx. 
s>sot Jo 0 


(Hint: See the proof of Theorem 4.5.12, p. 273.) 


Under the assumptions of Exercise 28, show that 


lim e* f(x)dx = / e * F(x)dx, r>0. 


S>So+ r r 
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30. 


31. 


32. 


33. 


Suppose f is continuous on [0, oo) and 
io) 
F(s) = e ** f(x) dx 
0 
converges for s = so. Show that lims_.o9 F(s) = 0. (Hint: Integrate by parts.) 


(a) Starting from the result of Exercise 18(d), let b — oo and invoke Exer- 
cise 30 to evaluate 


(b) Use (a) and Exercise 28 to show that 


(a) Suppose f is continuously differentiable on [0, 00) and 
| f(x)| < Me *, O<x<00. 


Show that 


G(s) = [em reas 


converges uniformly on [s1, 00) if s; > so. (Hint: Integrate by parts.) 
(b) Show from part (a) that 


[o.@) 
_ 2. 2; 
Go) = | e **xe* sine” dx 
0 


converges uniformly on [p, oo) if p > 0. (Notice that this does not follow 
from Theorem 6 or 8.) 


Suppose f is continuous on [0, co), 


am £2) 
im 


x—>0+ x: 
exists, and 


F(s) = ie e ** f(x) dx 


converges for s = so. Show that 


i F(u)du = [ ee LO) dx. 


0 


28 


10 Answers to selected exercises 


5. (b) If f(x,y) = 1/y for y 4 0 and f(x,0) = 1, then is F(x, y) dx does not 
converge uniformly on [0, d] for any d > 0. 


6. (a), (d), and (e) converge uniformly on (—oo, p] U [p, co) if p > 0; (b), (c), and (f) 
converge uniformly on [p, 00) if p > 0. 


© cos 


17. Let C(y) = ud dx and S(y) = 7 cut dx. Then C(O) = oo and 
Xx 1 x 


1 
S(0) = 0, while S(yv) = 2/2 if y £0. 


14 a4 a 1 a+l 
18. (a) F(y) = ——-; I = —log— (b) F(y) = ——; J = log —— 
(a) F(y) a] 5 WES (b) F(y) Gai ar 
y 1b? +1 
(c) F(y) PE I+ 
1 
d) F(y) = ; I =tan7!b-—tan7! 
(d) F(y) are an anla 
y 1 2 
F(y) = ; 7T = —log(l 
(e) F(y) y+ 5 lost +a‘) 
1 
F = - 7 =tan7! 
(f) F(y) y+ an a 


19. (a) (-1)""\(y +1)" (b) 2-7"! (” Va 


! 
(©) Saar (oss)? @) 


22. ie |x" f(x)| dx < 00 


(log x)? 


24. No; the integral defining F diverges for all y. 


31. (a) : = tana 


29 


